Video 5.2 getting started with Amazon kinases. In this video, we will learn the following. What is Amazon kinases? Why are they using Amazon kinases, firehose, Amazon kinases data firehose pricing? What is Amazon kinases? Basically, kinesis helps us in collecting, processing and analyzing real time data to get insights and react quickly to the new information.
Amazon kinesis is an AWS service that processes large data in real time. It is actually a data streaming service that delivers data reliably from one end to the other. It also adds extensions so as to make data processing easy and scalable. Amazon kinases can be broadly divided into four categories kinesis, data stream, kinases, data, firehose, kinesis data analytics, and kinesis video stream. Now let's look into each of these kinases data stream. Amazon kinases data stream is a highly scalable and durable real time data streaming service.
It can continuously capture large amounts of data per second from hundreds and thousands of sources. In kinases data stream you will pay only for what you use. Okay, let's break this down into simple words. Amazon kinesis data stream access a high capacity pipeline that will collect data from one end and send the data to the other end. Next kinesis data firehose Amazon kinases data firehose is a fully managed service that sends the streaming data into data storage and analytical tools. It collects transforms and since the streaming data to various endpoints like Amazon s3, Amazon redshift, Amazon Elastic Search etc.
It can compress transform and encrypted data before sending which will minimize the storage amount used The destination and also increases the security kinesis data analytics Amazon kinesis data analytics is a simple way to analyze the incoming data and gain insights to take effective actions in real time. But in our project, we will be using Amazon quick site for visualization. This is because we want to store the data and then visualize it later, according to our wish. But in kinesis data analytics, the incoming real time data is analyzed and effective actions are taken. kinases video stream Amazon kinesis video stream is an AWS service that helps you to stream live videos from devices to the AWS cloud, or built in applications for real time video processing. It also stores the video and allows you to watch those video streams in real time when received to the cloud.
Kinesis video streams captures massive amounts of live video data from millions of sources using smartphones security cameras webcams, cameras embedded in cars, drones and other sources. You can also send other types of data like audio data kinesis video streams automatically stores the data and encrypts it. In our project. We will be using kinesis data firehose. But why are we using kinesis data firehose? We need to store the data in the Amazon s3 bucket before visualizing the data in Amazon quick site.
So we use kinesis data firehose as a pipeline to send data from IoT Core to s3. But are you wondering why can't it directly connect IoT code to s3? using Amazon kinesis data firehose? We convert the incoming data to a columnar format Apache pocket before storing the data in Amazon s3 for cost effective storage and easy analytics. Okay, but what exactly is Apache packet in Apache packet the other available data is formatted into columns like tables. This columnar format lets you read and process the columns that are required easily in this pocket format.
The data is also compressed which helps us in improving the performance and lowering the storage and processing costs. In Amazon kinases data firehose, there is no minimum fee or setup cost, you will pay only for the volume of data ingested into kinases, firehose, and if applicable for data format conversion to Apache packet or OSC. Now, let's understand the details of Amazon kinesis data firehose pricing pricing of Amazon kinesis data firehose can be divided broadly into two parts pricing based on the volume of data ingested, and pricing based on the data formatting. Now, let's look into both of these. Pricing based on volume of data ingested. Here will calculate the size of each data record and also the number of data records that are being sent.
The size of each record is rounded to the nearest five kb. For example, if each data record is 32 kB, then kinases data firehose will count it as 35 KB of data. So, based on the total amount of data will be charged for North Virginia region. If you ingest one GB of data, then you will be charged 0.0 to $9 pricing based on the data formatting, if you convert the incoming data into Apache packet or Apache or C format, before delivering the data to the destination, format conversion charges applied based on the volume of incoming data for North Virginia region. If you format one GB of data, then you will be charged 0.01 $8 if you're not using the North Virginia region, then select the link in the resources section. It will direct you to a page like this clear You can learn more about kinesis firehose pricing, scroll down here, you can change to your location and look at the pricing.
For now, I will end this video here. In this video, we have learned the following. What is Amazon kinesis? Why are we using Amazon kinesis firehose Amazon kinesis data firehose pricing. In the next video, we will create a delivery stream with kinases firehose.