Amazon redshift: bulk insert vs COPYing from s3

Question

I have a redshift cluster that I use for some analytics application. I have incoming data that I would like to add to a clicks table. Let\'s say I have ~10 new \'cl

Answer 1

It might be worth implementing micro batching while performing bulk uploads to Redshift. This article may be worth reading as it does also contain other techniques to be followed for better performance of the COPY commmand.

http://blogs.aws.amazon.com/bigdata/post/Tx2ANLN1PGELDJU/Best-Practices-for-Micro-Batch-Loading-on-Amazon-Redshift