Sometimes it is hard to grasp what exactly a software does. That’s why we put together a list of frequently asked (& anticipated) questions below. We hope that these answers clear up any questions that you had!
# What can I do using FlyData Sync?
FlyData Sync replicates your MySQL database(s) to your Amazon Redshift cluster, usually within less than an hour. This is a big deal since it allows you to have all your data in one place, query-able together. Instead of spending hours/days to combine data from various data sources, you can gain insight from your data quickly, and almost immediately after the data being generated.
# How does FlyData work, at a high level?
FlyData has a process monitoring any changes made to the binlog of your MySQL. The binlog records any changes made to your MySQL databases. FlyData use this information to replicate your data to Amazon Redshift quickly by parallel processing data transformation and loading.
# Can you replicate multiple MySQL databases to a single Redshift cluster?
Yes, in fact, many customers do this so that they can query all their data more easily.
# How fast does the replication work?
How fast you can see your data in your Redshift cluster will depend on how much updates you are making to your database. Normally, your data will appear in your Redshift cluster within 15 minutes after the data change was made in your database.
# What are the system requirements?
Below are the system requirements. Supported OSs: Ubuntu/Debian 12.04+ and CentOS/Redhat 5+ Data source: MySQL 5.1+, RDS MySQL 5.6*, MariaDB 12+ EC2 minimum size: m1.small. c3.large recommended * At minimum, 5.6 Read Replica is needed
# What do I need to do for setup?
At a high level, you will need to:
Specify your Redshift cluster info and edit security group settings so that FlyData can write to your cluster
Specify your MySQL info, add in necessary MySQL database parameters, and edit security group settings so that FlyData can capture data changes made on your MySQL server.
Run a few commands to complete the setup.
# What happens when I INSERT a record in MySQL?
Whenever you make a change on your MySQL database, this change gets recorded in the binlog. FlyData monitors this binlog, takes any additional data in the binlog, transforms this into a Amazon Redshift-compatible format, saves to an S3 bucket, and COPYs the data over to your Redshift cluster. Read more on how FlyData replicates MySQL data to Amazon Redshift.
# How does pricing work?
We have three tiered plans (Basic, Professional, and Enterprise) for customers with larger datasets. Each tier has a set amount of data sending included per month, with any overages charged at an incremental rate. The tiered plans are a much better deal when you have lots of updates to your database every month. We also have a Pay As You Go plan, which is tailored towards customers with smaller data needs. Charges are calculated based on the number of the records sent during that month (e.g., if 50,000 rows are updated per day, then monthly cost is about $0.04*50KR*30d = $60), which gets charged to your credit card. If you have any plan related questions, please reach out to us at firstname.lastname@example.org
Although this only covers a very limited number of questions, we hope that they were able to shed some light on what FlyData Sync is and how it can help your business. I’d love to keep growing this list of questions and answers, so if you have a question you wanted to ask, please reach me at email@example.com and I’ll do my best to add my answer here. Thanks!