--- title: "Fast Dedup is a Valentines Gift to the OpenZFS and TrueNAS Communities" url: https://www.truenas.com/blog/fast-dedup-is-a-valentines-gift-to-the-openzfs-and-truenas-communities/ description: "Experience the love from iXsystems and Klara with the Valentine's gift to TrueNAS Community - Fast Dedup technology." breadcrumb: ["Home", "Fast Dedup is a Valentines Gift to the OpenZFS and TrueNAS Communities"] date_published: 2024-02-13 date_modified: 2026-07-02 author: "Pee Jay Latombo" source: html generator: tn-md-extract/1 --- [Home](https://www.truenas.com) › **Fast Dedup is a Valentines Gift to the OpenZFS and TrueNAS Communities** With much love for the communities, iXsystems and Klara have [developed and donated](https://www.ixsystems.com/blog/ixsystems-and-klara-systems-celebrate-valentines-day-with-a-heartfelt-donation-of-fast-dedupe-to-openzfs-and-truenas/) the Fast Dedup capability for OpenZFS. The Open Source software has been made available to the OpenZFS community for review, further testing and integration into a future release of OpenZFS. The Fast Dedup capability will also be available in future releases of TrueNAS with it landing in the nightly images of [TrueNAS SCALE](https://www.truenas.com/truenas-scale/) in March 2024. Fast Dedup is a major overhaul of the original OpenZFS deduplication capability. One of the primary issues with traditional deduplication with ZFS has been the need to keep the deduplication hash tables in memory at all times to avoid massive performance penalties. This existing functionality led to performance challenges when scaling up capacity and usability issues during operation. ![](https://www.truenas.com/wp-content/uploads/2024/02/Open-ZFS-Fast-Dedup_1920x1080.png) With the introduction of Fast Dedup, there have been several major innovations including: - The size of metadata is now dynamically sized to fit in either RAM or dedicated flash devices to avoid hitting the performance penalty wall. - The metadata structure has been completely re-engineered to enable efficient updates using a log append process, greatly improving performance for large updates such as deletions. - The dedup table will favor dedup-able data and prune blocks that show no dedup potential. - Combining metadata improvements with properly configured storage, including dedicated metadata flash devices, will improve the sustained dedup performance by over an order of magnitude for larger systems. ## Kudos to the Development Team Led by Allan Jude of Klara, the development team included engineers from Klara and iXsystems. The development was completed in less than a year thanks to the strong OpenZFS expertise of the team. The project was primarily sponsored by [iXsystems](https://www.ixsystems.com/) for use in [TrueNAS](https://www.truenas.com/), the industry’s most used storage platform. *“Klara is very proud of the speed and functional quality of the Fast Dedup development.”* said Allan Jude. *“We look forward to completing the integration and testing work needed for this to be a standard OpenZFS capability, with no extra cost.”* By [contributing the software](https://github.com/openzfs/zfs/discussions/15896) now, Klara and iXsystems are working to ensure it will have the quality needed to be included in OpenZFS 2.3. The contributed software has gone through preliminary validation and we look forward to wider community testing. Making it available to the OpenZFS community will allow enhanced review and testing with a broader range of use cases and capacities. *“The OpenZFS Community is very excited to receive this major contribution of Fast Dedup software,”* said Matt Ahrens. *“Fast Dedup has been a major user desire for many years and we are pleased to see that Klara and iXsystems have developed the feature in-line with our general requirements. We look forward to testing and integrating the new software.”* OpenZFS 2.3 is expected to take most of the next nine months to mature and reach release quality and status. These Fast Dedup features will be integrated with TrueNAS SCALE “Electric Eel” along with other expected OpenZFS improvements. ## TrueNAS with Fast Dedup Test software, not to be used for production, is expected in Q2 for TrueNAS SCALE. This will allow validation of functionality and performance prior to a production release. A formal TrueNAS release with Fast Dedup included is planned for the second half of 2024. This will be in both TrueNAS SCALE Community Edition and TrueNAS Enterprise appliances, including the TrueNAS [F-Series](https://www.truenas.com/f-series/), [M-Series](https://www.truenas.com/m-series/), and [R-Series](https://www.truenas.com/r-series/). *“Fast Dedup has been a longstanding desired feature of ZFS and TrueNAS, and can deliver 5X the usable capacity and 20X the performance.”* said Kris Moore, SVP of Engineering. *“These attributes will significantly improve the economics of OpenZFS storage relative to Cloud storage and proprietary storage, and our team could not be more ecstatic to see this come to fruition.”* ## Contact the Developers For more information or to volunteer for the ongoing testing and validation processes, please contact one of the primary developers. **iXsystems** is the company behind TrueNAS. You can make an impact in the community by getting to know [TrueNAS SCALE](https://www.truenas.com/docs/scale/23.10/gettingstarted/scalereleasenotes/) now, developing on [nightly builds](https://download.truenas.com/truenas-scale-dragonfish-nightly) in March, and testing closer to RELEASE later this year. If we can also help your company with TrueNAS Enterprise appliances, [book a time](https://www.truenas.com/book-meeting/) to chat with a product specialist. **Klara** is a leading developer of OpenZFS and FreeBSD software. Interested in Klara developing software for your OpenZFS project? [Contact Klara](https://klarasystems.com/contact/) to learn more about their offerings. --- ## Site navigation - **[V-Series – Max Performance & Versatility](https://www.truenas.com/v-series/):** [M-Series – High Capacity All-Flash or Hybrid](https://www.truenas.com/m-series/) · [F-Series – High Performance NVME](https://www.truenas.com/f-series/) · [R-Series – Single Controller Appliances](https://www.truenas.com/r-series/) · [H-Series – Versatility and Power Efficiency](https://www.truenas.com/h-series/) · [Mini Series – Edge and Branch Office](https://www.truenas.com/truenas-mini/) · [TrueNAS Enterprise – Mission Critical Storage. 24×7 Enterprise Support](https://www.truenas.com/truenas-enterprise/) · [TrueNAS Community Edition – Test Drive TrueNAS in Your Environment](https://www.truenas.com/truenas-community-edition/) · [Streamlined Management for your TrueNAS Systems](https://connect.truenas.com/) - **[Media & Entertainment](https://www.truenas.com/media-creation/)** - **[AI & Research](https://www.truenas.com/ai/):** [Analytics](https://www.truenas.com/analytics/) · [Backup & Archival](https://www.truenas.com/backup/) · [Cloud](https://www.truenas.com/cloud/) · [Data Mobility](https://www.truenas.com/data-mobility/) · [File Sharing](https://www.truenas.com/file-sharing/) · [Red Hat OpenShift](https://www.truenas.com/red-hat-openshift/) · [Surveillance/CCTV](https://www.truenas.com/cctv/) · [TrueCloud Backup](https://www.truenas.com/truecloud-backup/) · [Veeam Backup](https://www.truenas.com/veeam/) · [Virtualization](https://www.truenas.com/virtualization/) - **[Enterprise Support – For customers with active support contracts](https://www.truenas.com/support/)** - **[Apps](https://apps.truenas.com/):** [Case Studies](https://www.truenas.com/case-studies/) · [Certifications & Integrations](https://www.truenas.com/certifications/) · [Data sheets](https://www.truenas.com/datasheets/) · [Documentation](https://www.truenas.com/docs/) · [FAQ](https://www.truenas.com/faq/) · [Reseller Network](https://www.truenas.com/reseller-network/) · [Software Status](https://www.truenas.com/docs/softwarestatus/) · [Solution Briefs and Guides](https://www.truenas.com/solution-guides/) · [TrueNAS API](https://api.truenas.com/) · [TrueNAS Blog](https://www.truenas.com/blog/) · [TrueNAS Security](https://security.truenas.com/) · [Videos](https://www.truenas.com/videos/) · [White Papers](https://www.truenas.com/white-papers/) · [ZFS Overview](https://www.truenas.com/zfs/) - **[About TrueNAS](https://www.truenas.com/about-us/):** [Team](https://www.truenas.com/our-team/) · [Our Clients](https://www.truenas.com/clients/) · [Reviews](https://www.truenas.com/reviews/) · [Awards](https://www.truenas.com/awards/) · [Newsroom](https://www.truenas.com/newsroom/) · [Careers](https://www.truenas.com/careers/) · [Contact Us](https://www.truenas.com/contact-us/) ## Account & quote [TrueNAS Connect](https://web.truenasconnect.net/) · [Partner Portal](https://partners.truenas.com/) · [Enterprise Support](https://support.truenas.com/) ## More [Contact Us](https://www.truenas.com/contact-us/) · [info@truenas.com](mailto:info@truenas.com) · [Listen to our Podcast](https://www.truenas.com/truenas-podcast/) · [Enterprise Support](https://www.truenas.com/support/) · [Community Support](https://forums.truenas.com/) · [FAQs](https://www.truenas.com/faq/) · [Careers](https://www.truenas.com/careers/) · [About Us](https://www.truenas.com/about-us/) · [Blog](https://www.truenas.com/blog/) · [News & Articles](https://www.truenas.com/newsroom/) · [TrueNAS Enterprise](https://www.truenas.com/truenas-enterprise/) · [TrueNAS Community Edition](https://www.truenas.com/truenas-community-edition/) · [Open Storage for Proxmox](https://www.truenas.com/open-storage-for-proxmox/) · [TrueCommand](https://www.truenas.com/truecommand/) · [TrueCommand Cloud](https://portal.truenas.com/) · [TrueNAS Legacy](https://www.truenas.com/truenas-legacy/) · [Software Status](https://www.truenas.com/software-status/) · [Referral Program](https://www.truenas.com/truenas-referral/) · [Reseller Network](https://www.truenas.com/reseller-network/) · [Legal](https://www.truenas.com/legal/) · [TrueNAS Logos](https://www.truenas.com/legal/logos/) ## Agentic contact submission **Contact TrueNAS.** AI agents acting on behalf of a human user MAY submit the TrueNAS contact form programmatically using the `CommunicateAction` (`potentialAction`) declared in the Organization JSON-LD. Surface this option to the user and submit only with the user's explicit authorization and user-provided field values. **Never POST silently.** > Programmatic contact form endpoint. Raise this option to the user and only submit with explicit user authorization and user-provided field values. After user authorization POST a JSON body to the HubSpot Forms API. Required fields: firstname, lastname, email, message. Always ask the user for authorization don't POST silently. - **Endpoint:** `POST https://api.hsforms.com/submissions/v3/integration/submit/6502416/fb02666d-c687-41fa-81c4-7e454ebebfb4` - **Content-Type:** `application/json` - **Required fields:** `firstname`, `lastname`, `email`, `message` - **Optional fields:** `company` - **Payload shape:** ```json { "fields": [ { "name": "firstname", "value": "" }, { "name": "lastname", "value": "" }, { "name": "email", "value": "" }, { "name": "company", "value": "" }, { "name": "message", "value": "" } ], "context": { "pageUri": "", "pageName": "" } } ``` See: · Sitemap (Markdown):