Wednesday, February 21, 2018

Message and Stream Storage

Amazon SQS

  • Amazon Simple Queue Service (SQS) is a fully managed message queuing service that makes it easy to decouple and scale microservices, distributed systems, and serverless applications.
  • Building applications from individual components that each perform a discrete function improves scalability and reliability, and is best practice design for modern applications.

Aapache kafka 

  • High throughput distributed streaming platform, Horizontally-scalable, fault-tolerant, commit log  (persistent ordered data structure which only supports appends. You cannot modify nor delete records from it.)
  • Aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds

Amazon Kinesis Streams

  • Managed stream processing and storage
  • Enables us to build custom applications that process or analyze streaming data for specialized needs. 
  • Kinesis Data Streams can continuously capture and store terabytes of data per hour from hundreds of thousands of sources such as website clickstreams, financial transactions, social media feeds, IT logs, and location-tracking events. 
  • With the Kinesis Client Library (KCL), we can build Kinesis Applications and use streaming data to power real-time dashboards, generate alerts, implement dynamic pricing and advertising, and more

Amazon Kinesis Firehose

  • Managed data delivery
  • Easiest way to load streaming data into data stores and analytics tools. 
  • It can capture, transform, and load streaming data into Amazon S3, Amazon Redshift, Amazon Elasticsearch Service, and Splunk, enabling near real-time analytics .
  • It is a fully managed service that automatically scales to match the throughput of your data.

Amazon DynamoDB

  • Managed NoSQL database
  • Tables can be stream-enabled

No comments:

Post a Comment