Follow

Data Fusion: Amazon S3

Time to read: 6 min

topic.pngThe article covers the following topics:

Amazon S3 (Amazon Simple Storage Service) is an object storage service that offers industry-leading scalability, data availability, security, and performance. This means customers of all sizes and industries can use it to store and protect any amount of data for a range of use cases, such as websites, mobile applications, backup and restore, archive, enterprise applications, IoT devices, and big data analytics. Amazon S3 provides easy-to-use management features to organize your data and configure finely-tuned access controls to meet your specific business, organizational, and compliance requirements. Amazon S3 is designed for 99.999999999% (11 9's) of durability, and stores data for millions of applications for companies all around the world.

How does it work?

Step 1. Set up your own Amazon S3 account visiting the website directly.

import.pngPlease, mind to turn on API at Amazon S3 side for Affise to pass the data and make sure the account has the "Owner" role; otherwise, there's no possibility to stream the data into the bucket.

Step 2.Fill in Amazon S3 configuration settings to create integration between your account and Amazon S3:

Markup 2020-06-01 at 17.24.50.png

Screenshot on 2020-06-18 at 16-55-07.png
The configuration settings include 2 forms: Clicks and Conversions to be filled in for sending raw data on all clicks and conversions, respectively. 

import.pngAll the fields should have the same data as your S3 account.

Where:

  • Directory - the way in the Bucket your data will be sent to.
  • Bucket - the main folder your data will be sent to in the created Storage.
  • Region - the region of a server location.

import.png Your account determines the Regions that are available to you. The Region code has its special format, for example, us-west-2.  For more information about the Regions codes, see Available Regions table, please.

  • Access key - an access key to Storage.
  • Secret key - a secret key to Storage. 

Step 3. On the plugin page, you can see some additional actions:

  • Delete integration - upon turning on the slider, the sync on sending the data from Affise to Amazon S3 is stopped, and it's completely erased from the Affise side, though all previously uploaded to Amazon S3 files will remain at their folders.
  • Tap on the Save button. As soon as your account is set up on Google Cloud side, your data on clicks and conversions will be sent to be stored there.

How does the system send information on clicks and conversions?

There are three steps:

  1. the system creates .csv file;
  2. then compresses it into .gz file;
  3. and sends it to Amazon S3 Storage.

The .gz format will save storage capacity. The file is sent every 15 minutes. 

The system initiates the creation of a folder tree according to the current date of exporting process execution and segment archives into the following folders: Year, Month, Day, and the files are named according to the date  {YYYY-MM-DD-hh-mm}, so it is pretty easy to navigate them.

Should you have any further doubts or questions on the Amazon S3 plugin work, feel free to contact our support team via support@affise.com.

Updated by Tatiana Mankevich

 

Was this article helpful?
2 out of 2 found this helpful
Have more questions? Submit a request

0 Comments

Please sign in to leave a comment.