Wednesday, February 21, 2018

Message and Stream Storage

Amazon SQS

  • Amazon Simple Queue Service (SQS) is a fully managed message queuing service that makes it easy to decouple and scale microservices, distributed systems, and serverless applications.
  • Building applications from individual components that each perform a discrete function improves scalability and reliability, and is best practice design for modern applications.

Aapache kafka 

  • High throughput distributed streaming platform, Horizontally-scalable, fault-tolerant, commit log  (persistent ordered data structure which only supports appends. You cannot modify nor delete records from it.)
  • Aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds

Amazon Kinesis Streams

  • Managed stream processing and storage
  • Enables us to build custom applications that process or analyze streaming data for specialized needs. 
  • Kinesis Data Streams can continuously capture and store terabytes of data per hour from hundreds of thousands of sources such as website clickstreams, financial transactions, social media feeds, IT logs, and location-tracking events. 
  • With the Kinesis Client Library (KCL), we can build Kinesis Applications and use streaming data to power real-time dashboards, generate alerts, implement dynamic pricing and advertising, and more

Amazon Kinesis Firehose

  • Managed data delivery
  • Easiest way to load streaming data into data stores and analytics tools. 
  • It can capture, transform, and load streaming data into Amazon S3, Amazon Redshift, Amazon Elasticsearch Service, and Splunk, enabling near real-time analytics .
  • It is a fully managed service that automatically scales to match the throughput of your data.

Amazon DynamoDB

  • Managed NoSQL database
  • Tables can be stream-enabled

1 comment:

  1. Your blog is nice. I believe this will surely help readers who are really in need of this vital piece of information. Thanks for sharing and kindly keep updating.

    IELTS Classes in Mumbai
    IELTS Coaching in Mumbai
    IELTS Mumbai
    Best IELTS Coaching in Mumbai
    IELTS Center in Mumbai