Tuesday, January 29, 2019

Ingestion in GCP



In the figure x axis is what is closer to GCP and y axis is the amount of data
These are the different approaches which we can take for data ingestion to GCP

TRANSFER SERVICE
Storage Transfer Service allows you to quickly import online data into Cloud Storage. You can also set up a repeating schedule for transferring data, as well as transfer data within Cloud Storage, from one bucket to another.




GSUTIL
gsutil is a Python application that lets you access Cloud Storage from the command line. You can use gsutil to do a wide range of bucket and object management tasks, including:
  • Creating and deleting buckets.
  • Uploading, downloading, and deleting objects.
  • Listing buckets and objects.
  • Moving, copying, and renaming objects.
  • Editing object and bucket ACLs.
Note:Network optimizations are provided by the partners

OFFLINE MEDIA SUPPORT
Offline Media Import / Export is a third party solution that allows you to load data into Cloud Storage by sending your physical media, such as storage arrays, hard disk drives (HDDs), tapes, and USB flash drives, to a third party service provider who uploads data on your behalf. Offline Media Import / Export is helpful if you’re limited to a slow, unreliable, or expensive Internet connection.

OFFLINE MIGRATION OF LIVE DATA
By leveraging Zadara's Cloud Hydration service we can easily migrate your static and production data to GCP, conveniently and without downtime.



No comments:

Post a Comment