Sqoop
| Developer(s) | Apache Software Foundation |
|---|---|
| Stable release | 1.4.6 / May 11, 2015 |
| Development status | Active |
| Written in | Java |
| Operating system | Cross-platform |
| Type | Data management |
| License | Apache License 2.0 |
| Website | sqoop |
Sqoop is a command-line interface application for transferring data between relational databases and Hadoop.[1] It supports incremental loads of a single table or a free form SQL query as well as saved jobs which can be run multiple times to import updates made to a database since the last import. Imports can also be used to populate tables in Hive or HBase.[2] Exports can be used to put data from Hadoop into a relational database. Sqoop got the name from sql+hadoop. Sqoop became a top-level Apache project in March 2012.[3]
Pentaho provides open source Sqoop based connector steps, Sqoop Import[4] and Sqoop Export,[5] in their ETL suite Pentaho Data Integration since version 4.5 of the software.[6] Microsoft uses a Sqoop-based connector to help transfer data from Microsoft SQL Server databases to Hadoop.[7] Couchbase, Inc. also provides a Couchbase Server-Hadoop connector by means of Sqoop.[8]
In 2015 Ralph Kimball described Sqoop as follow under the heading The Future of ETL:[9]
<templatestyles src="Template:Blockquote/styles.css" />
Several big changes must take place in the ETL environment. First, the data feeds from original sources must support huge bandwidths, at least gigabytes per second. Learn about Sqoop loading data into Hadoop. If these words mean nothing to you, you have some reading to do! Start with Wikipedia.
See also
References
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
Bibliography
- Lua error in package.lua at line 80: module 'strict' not found.
