Hi, Adrian, and welcome back.
Now, in today's video, we are going to discuss about Amazon Fz-x.
Now, one thing you have to note is that in the industry, there are multiple set of file systems that
are available for different set of use cases.
Now, if you are using Windows, one of the common set of file systems that you'll generally work with
is EFT 32 as well as the NTFS.
Now, I remember we were trying to play a song through a pen drive in a car, so we were planning for
a trip towards a lot of temples here in South India.
So songs were quite important so that the driver does not sleep.
So apparently there were so many songs in the pen drive, but pen Drive somehow was not working.
So when we inserted it, it was not really working well.
We had to go back up and we looked into the file system of that pen drive and it was based on Fat 32.
So we had experimented different set of file systems with different set of block sizes and ultimately
it worked with the NFS with a specific block size.
Otherwise the pen was not really working in the car.
Now the learning here is that you will see that there are multiple set of file systems and depending
upon the device, the file system requirements will also change.
Apart from that, in the industry, there are so many different type of workloads where different set
of file systems are required, and this is where the Amazon FS comes into picture.
Now, if you look into the overall basics on how things are implemented, one thing that you should
know is that there are multiple popular set of file systems that are available in the industry, and
the set of file systems are extensively used based on the organisation's use cases.
So let's take example of two of them.
One is the cluster and second is the open edifice.
Cluster is also very popular and it's a parallel distributed file system and is primarily used for the
high performance computing related requirements.
You also have the open ZFS, which also has its own advantages and supports the functionality of a traditional
file system and logical volume manager.
Now, taking an example of an Amazon Linux tool base instance, if you'll quickly look into the ETSI
FS type file, you will see that the file system that is being used here is ZFS.
Again, there are multiple set of file systems for Linux.
You have XD for X, HDFS and many others.
Now if you take a look into the file system that the drive's in, my workstation has, let's quickly
look.
So I'll quickly go to the properties and you see that the file system that is being used is NTFS.
All right.
So at this stage we have learned that there are multiple set of file systems depending upon the use
cases.
You should be using one of them.
Now when we discuss about organizations that are completely based on us, there will be a use cases
where they might have to leverage the rich feature sets and maybe the performance that these open source,
as well as commercially licensed file systems offer.
Now, generally when you implement it at a production level, there are a lot of challenges related
to the overall time consumption, administrative tasks, hardware provisioning, software configuration,
patching backups, etc. So in order to overcome these set of challenges for various popular file systems,
EA has released a service called F6.
So at a high level overview, the Amazon FS makes it easy and cost effective to launch and run popular
file systems.
Now, what are these popular file systems?
You can see you have the Amazon FS for Lustre, the Open ZFS, the Windows File server, again, very
popular for Windows specific workloads.
And you also have the ONTAP over here.
So one of the great benefits of FS here is that it provides a cost efficient capacity and high levels
of reliability for the set of file systems.
So the entire provisioning, hardware, everything is taken care by us and you can directly make use
of it.
Now before we explore this, let's look into some of the advantages.
First one is that it is simple and fully managed, so it takes care of it.
It is secure and compliant.
So all of these complies with various industry standard certifications like PCI, DSS, SOC, ISO and
others, and also the data is encrypted.
Apart from that, one of the major benefits since it is in the cloud is its integration with services.
For example, many of the file system, they integrate very well with services like three CMS, you
have sage maker, workspaces, parallel cluster and so on.
So with this basic benefits in mind, let's quickly jump into the demo and explore the FS service.
Now, currently I am in the FS console and as of now we have one specific file system that is configured
and this file system type is lustre.
Now if you look into the storage capacity, it is 1.2 TB and I have mounted the file system on the Amazon
Linux machine.
Now within our Amazon Linux machine, IT file quick.
Run the Mount Command.
You see, this specific entity is what we are referring to.
You see that we have this specific cluster file system that is mounted on the path of FS X, and this
is the IP address.
This IP address is nothing but the IP of the cluster.
For example, once your cluster file system is ready as part of FS X, it will give you a specific endpoint.
So if you see there is this specific DNS name, so this is the endpoint and then you can connect this
file system with the EC2 instance and this is what it refers to.
So if I quickly look into the FS directory where the file system is mounted, you see that there are
certain files that are available over here.
Now, whenever you go ahead and you create a file system, let me quickly show you.
So at this stage there are four file systems that are available in the future.
There might be more that might also be available, but that does not matter at this stage, primarily
because we are learning about the FS service at a high level overview.
Now, generally whenever you go ahead and create a file system, all you'll have to do is you will have
to give it a name, you will have to specify the storage capacity.
As you see over here, you have to specify the VPC and maybe the encryption related configuration,
and you can directly create the file system no longer, as you are discussing, no longer you have to
take care of administrative tasks like hardware provisioning, software configuration, patching, backups,
etc. Everything is taken care by us.
So let's do one thing before we conclude.
Let's have a quick walkthrough for each of these file systems and we'll look into some of the key pointers
here.
The first one is the PFS for Luster at the overview for any use cases related to the high performance
computing, the cluster file system is quite recommended.
Now one of the great benefits again for Lustre is that it integrates very well with various services
like S3 stage maker Xe.
ET cetera.
Now let me quickly show you an interesting thing here.
Now I have a S3 bucket college CPU lab sample acid bucket, and this bucket is connected with this lustre
file system that we have created.
So whatever data that you upload in this specific bucket will be available in our file system.
And similarly, whatever data that you add as part of the file system will be available in the S3 bucket,
Let's quickly look into it, so I'll quickly upload a file to this bucket.
Let's add it.
So I've added a file 02..
Let's upload this file.
All right.
Grid now from our Amazon Linux machine.
If we'll do a LL's L on the F6 folder where the file system is mounted, you'll see our file zero two
is now available.
All right.
So I hope with this you understood the second pointer related to how the file systems.
It also integrates with various services like S three and others.
The second primary one is the FS for Windows File server.
From the name itself, we can identify that this is primarily for Windows Server related use cases.
So this is a fully managed, highly reliable file storage that is accessible via the server message
block protocol or the SMB protocol.
The benefit of this file system is that it is built on Windows Server and it provides full SMB support
and also support for wide range of administrative features like user quota data, deduplication and
others.
Now, although this is a Windows file server, it is accessible from Windows Linux as well as Mac OS.
And the last very important point associated with this file system is that it integrates with Microsoft
Active Directory to support Windows environments and enterprises.
The third one is the PFS for open ZFS.
So this option provides the cost effective HIGH-PERFORMANCE file storage, which is built on the open
ZFS file system, and it is accessible through the NFS protocol.
So as part of the open ZFS, there are multiple capabilities that this file system has related to compression
and others.
So all of these capabilities are also something that you will get as part of this.
The last one is the FS for NetApp ONTAP, and this is based on the NetApp popular ONTAP file system.
And again, it is fully managed by us.
Now.
This is accessible through NFS, SMB and iSCSI Protocol and also this type of file system.
It integrates with Microsoft Active Directory to support Windows environments and enterprises.
So this is a very high level overview about the Amazon FS service and with this will conclude today's
video.