Load data into Redshift using ZappyShell Command Line tools
Description
Learn how to load data into redshift using simple command line. Read more.. http://zappysys.com/products/zappyshell/amazon-redshift-command-line-tools/
Command line for Amazon Redshift
◾Import data to AWS Redshift database from files or relational source (e.g. MySQL, Oracle, SQL Server)
◾Import huge amount of data (millions of rows) in few minutes with parallel load techniques
◾Load local flat files to Redshift in just single line command (option to compress data files to *.gz to speed up transfer)
◾Support for Client side encryption using AES 256 Key
◾Load data from any data source (ODBC,ADO.net or OLEDB) using sql query
◾Import compressed data files (*.gz) to redshift
◾Archive files, error reporting, file splitting, many other features
======================
Examples:
======================
##############################################
#below command will import data from any relation source (e.g. SQL Server) into redshift DB
##############################################
import Db
--source-driver ADONET_MSSQL
--source-query "SELECT top 10000 ROW_NUMBER()Over(order by a.CustomerID) Id , a.*,b.*,c.OrderID ,c.OrderDate,c.Freight FROM customers a,products b,orders c"
--maxrows-perfile 1000
--source-stagepath "c:\redshift\stage"
--target-table "customerdata"
--target-stagepath "bw-rstest/cmdstage"
--target-truncate
--logfile "c:\redshift\log.txt"
--region us-east-1
--accesskey "AKIA*****************"
--secretkey "lPi+XQ************************"
--source-connstr "Data Source=localhost;Initial Catalog=Northwind;Integrated Security=SSPI;"
--target-connstr "Host=mytestcluster-1.csu********.us-east-1.redshift.amazonaws.com;Port=5439;Database=dev;UserName=masteruser;Password=*********;EnableSsl=true;Timeout=30;CommandTimeout=3600;"
##############################################
#below command will import local files in redshift DB
##############################################
import file
--source-path "c:\data\files\*.part.csv"
--source-stagepath "c:\redshift\stage"
--target-table "customerdata"
--target-stagepath "bw-rstest/cmdstage"
--target-truncate
--logfile "c:\redshift\log.txt"
--region us-east-1
--accesskey "AKIA*****************"
--secretkey "lPi+XQ************************"
--source-connstr "Data Source=localhost;Initial Catalog=Northwind;Integrated Security=SSPI;"
--target-connstr "Host=mytestcluster-1.csu********.us-east-1.redshift.amazonaws.com;Port=5439;Database=dev;UserName=masteruser;Password=*********;EnableSsl=true;Timeout=30;CommandTimeout=3600;"
Command line for Amazon Redshift
◾Import data to AWS Redshift database from files or relational source (e.g. MySQL, Oracle, SQL Server)
◾Import huge amount of data (millions of rows) in few minutes with parallel load techniques
◾Load local flat files to Redshift in just single line command (option to compress data files to *.gz to speed up transfer)
◾Support for Client side encryption using AES 256 Key
◾Load data from any data source (ODBC,ADO.net or OLEDB) using sql query
◾Import compressed data files (*.gz) to redshift
◾Archive files, error reporting, file splitting, many other features
======================
Examples:
======================
##############################################
#below command will import data from any relation source (e.g. SQL Server) into redshift DB
##############################################
import Db
--source-driver ADONET_MSSQL
--source-query "SELECT top 10000 ROW_NUMBER()Over(order by a.CustomerID) Id , a.*,b.*,c.OrderID ,c.OrderDate,c.Freight FROM customers a,products b,orders c"
--maxrows-perfile 1000
--source-stagepath "c:\redshift\stage"
--target-table "customerdata"
--target-stagepath "bw-rstest/cmdstage"
--target-truncate
--logfile "c:\redshift\log.txt"
--region us-east-1
--accesskey "AKIA*****************"
--secretkey "lPi+XQ************************"
--source-connstr "Data Source=localhost;Initial Catalog=Northwind;Integrated Security=SSPI;"
--target-connstr "Host=mytestcluster-1.csu********.us-east-1.redshift.amazonaws.com;Port=5439;Database=dev;UserName=masteruser;Password=*********;EnableSsl=true;Timeout=30;CommandTimeout=3600;"
##############################################
#below command will import local files in redshift DB
##############################################
import file
--source-path "c:\data\files\*.part.csv"
--source-stagepath "c:\redshift\stage"
--target-table "customerdata"
--target-stagepath "bw-rstest/cmdstage"
--target-truncate
--logfile "c:\redshift\log.txt"
--region us-east-1
--accesskey "AKIA*****************"
--secretkey "lPi+XQ************************"
--source-connstr "Data Source=localhost;Initial Catalog=Northwind;Integrated Security=SSPI;"
--target-connstr "Host=mytestcluster-1.csu********.us-east-1.redshift.amazonaws.com;Port=5439;Database=dev;UserName=masteruser;Password=*********;EnableSsl=true;Timeout=30;CommandTimeout=3600;"
Keywords & Tags
More from User
06:38
SSIS Export Excel Task - Generate excel Dynamically
Zappysys
11:30
Query/Read data from Amazon DynamoDB Table, Write JSON documents into DynamoDB
Zappysys
06:07
SSIS JSON Export Task - Generate JSON file from SQL Server, MySQL or Oracle Tables
Zappysys
05:18
SSIS MongoDB Source - Use SQL Like Query Language for reading MongoDB Collection
Zappysys
13:45
SSIS HTML Table Source - Web scraping without coding from any URL
Zappysys
07:40
SSIS MongoDB Destination - Generate and load JSON Documents into MongoDB Collection
Zappysys
Related Videos
04:58
Top 5 Networking Tools in the Command Line
os-alt
00:06
Download Windows 7 and Vista Guide to Scripting Automation and Command Line Tools PDF Free
Nuver0
00:30
Download Advanced PDF Tools Command Line 3.01 Serial Key Generator Free
Hkbmd7ap
07:50
Windows Command Line Tutorial - 9 - Copying and Moving Files (1024p FULL HD)
FragmenTv
12:46
Typeset.css Responsive Design Techniques Command Line Tools The Treehouse Show Episode 16
TEAM TREE HOUSE
37:35
Informatica Online Training | Informatica Powercenter Training Videos
BigClasses