Ext4 Vs XFS Filesystem - Survey Of Popularity - Cloudera Community

Trang chủ » Xfs Và Ext4 » Ext4 Vs XFS Filesystem - Survey Of Popularity - Cloudera Community

Có thể bạn quan tâm

logo
  • Community
  • Training
  • Partners
  • Support
Support Questions Find answers, ask questions, and share your expertise All communityThis categoryThis boardCommunity ArticlesUsers cancel Turn on suggestions Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type. Showing results for  Show  only  | Search instead for  Did you mean:  Advanced Search Announcements Now Live: Explore expert insights and technical deep dives on the new Cloudera Community Blogs — Read the Announcement
  • Cloudera Community
  • Support
  • Support Questions
  • Ext4 vs XFS Filesystem - Survey of Popularity
Options Options Solved Go to solution

Ext4 vs XFS Filesystem - Survey of Popularity

Labels:
  • Apache Hadoop
avatar author-rank wfloyd Expert Contributor

Created ‎12-02-2015 09:15 PM

12-02-2015 09:15:22

Wanted to see how many people have clusters where the HDFS DataNodes are running on XFS vs Ext4 filesystems? I'm trying to get a sense for which filesystem is chosen most often in the wild. Feel free to comment if you have a preference for one vs the other.

Thanks!

Reply 21,537 Views 7 Kudos 1 ACCEPTED SOLUTION avatar author-rank pcodding author-rank Guru

Created ‎12-03-2015 10:42 PM

12-03-2015 10:42:40

From a SmartSense perspective it's about 80% ext4, and 20% XFS. We recommend using either and have specific mount options for each type of filesystem.

View solution in original post

Reply 12,967 Views 5 Kudos
  • All forum topics
  • Previous
  • Next
13 REPLIES 13 avatar author-rank nsabharwal Master Mentor

Created ‎12-02-2015 09:16 PM

12-02-2015 09:16:34

@Wes Floyd All ext4 ...None XFS

Reply 11,748 Views 1 Kudo avatar author-rank jstraub Guru

Created ‎12-02-2015 09:37 PM

12-02-2015 09:37:02

+1 .......

Reply 11,748 Views 1 Kudo avatar author-rank bsaini Guru

Created ‎12-02-2015 09:32 PM

12-02-2015 09:32:01

I've seen very little ext3 and mostly ext4 for the on prem deployments.

AWS EBS is xfs by default. XFS has its advantages but in a JBOD setup, it doesn't really provide lot of benefits.

Reply 11,748 Views 0 Kudos avatar author-rank pcodding author-rank Guru

Created ‎12-03-2015 10:42 PM

12-03-2015 10:42:40

From a SmartSense perspective it's about 80% ext4, and 20% XFS. We recommend using either and have specific mount options for each type of filesystem.

Reply 12,968 Views 5 Kudos avatar author-rank gholmes New Member

Created ‎03-30-2017 05:54 PM

03-30-2017 05:54:57

What are the recommended mount options for xfs?

Reply 11,748 Views 0 Kudos avatar author-rank skumpf author-rank Rising Star

Created ‎12-03-2015 11:02 PM

12-03-2015 11:02:00

FWIW, XFS is the default in RHEL 7, so I expect an uptick in new clusters.

Reply 11,748 Views 4 Kudos avatar author-rank nsabharwal Master Mentor

Created ‎12-04-2015 12:53 AM

12-04-2015 12:53:12

@Shane Kumpf @Wes Floyd

That's good to know https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/Migration_Planning_Gui...

XFS is a very high performance, scalable file system and is routinely deployed in the most demanding applications. In Red Hat Enterprise Linux 7, XFS is the default file system and is supported on all architectures. Ext4, which does not scale to the same size as XFS, is fully supported on all architectures and will continue to see active development and support.

Reply 11,748 Views 1 Kudo avatar author-rank bsaini Guru

Created ‎12-04-2015 04:57 AM

12-04-2015 04:57:30

This should be updated / corrected then?

Partitioning Recommendations for Slave Nodes Hadoop Slave node partitions: Hadoop should have its own partitions for Hadoop files and logs. Drives should be partitioned using ext3, ext4, or XFS, in that order of preference. HDFS on ext3 has been publicly tested on the Yahoo cluster, which makes it the safest choice for the underlying file system. The ext4 file system may have potential data loss issues with default options because of the "delayed writes" feature. XFS reportedly also has some data loss issues upon power failure. Do not use LVM; it adds latency and causes a bottleneck.

Source: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_cluster-planning-guide/content/ch_partiti...

A lot of this conflicts with the reality (Paul's Smartsense statistics) and what we all are discussing here.

Reply 11,748 Views 0 Kudos avatar author-rank clove New Member

Created ‎03-04-2016 07:29 PM

03-04-2016 07:29:33

Also same goes with LVM. I am thinking that LVM (without snapshots), and ext4 or xfs is good ...

Reply 11,748 Views 1 Kudo Load more replies Post Reply
  • Previous
    • 1
    • 2
  • Next
Announcements Community Announcements Announcing the Launch of Cloudera Community Blogs Community Announcements October / November 2025 Community Highlights What's New @ Cloudera Announcing Cloudera Streaming Analytics - Kubernetes Operato... What's New @ Cloudera Announcing Cloudera Streams Messaging - Kubernetes Operator ... Community Announcements Welcome to the Cloudera Community! View More Announcements

Từ khóa » Xfs Và Ext4