THDFSPut − Copies file/folder from local file system (user-defined) to hdfs at the given path. THDFSList − Retrieves all the files and folders in the given hdfs path. THDFSInput − Reads the data from given hdfs path, puts it into talend schema and then passes it to the next component in the job.
THDFSConnection − Used for connecting to HDFS (Hadoop Distributed File System). The list of Big Data connectors and components in Talend Open Studio is shown below − The list of categories with components to run a job on Big Data environment included under Big Data, is shown below − It also gives you the option to connect with several Big Data distributions like Cloudera, HortonWorks, MapR, Amazon EMR and even Apache. It automatically generates MapReduce code for you, you just need to drag and drop the components and configure few parameters. You have plenty of big data components available in Talend Open Studio, that lets you create and run Hadoop jobs just by simple drag and drop of few Hadoop components.īesides, we do not need to write big lines of MapReduce codes Talend Open Studio Big data helps you do this with the components present in it. Talend Open Studio – Big Data is a free and open source tool for processing your data very easily on a big data environment. The tag line for Open Studio with Big data is “Simplify ETL and ELT with the leading free open source ETL tool for big data.” In this chapter, let us look into the usage of Talend as a tool for processing data on big data environment.
0 kommentar(er)
