• Over 5+ Years of IT experience and Currently working in a Big Data Capacity with the help of Hadoop Eco System across internal and cloud based platforms.
• Working knowledge of Hadoop, Hive, Sqoop, Pig, HBase & Oozie in real time environment and worked on many modules for performance improvements and architecture designing.
• Experience in layers of Hadoop Framework - Storage (HDFS), Analysis (Pig and Hive) &Engineering (Jobs and Workflows) for developing ETL processes to load data from multiple data sources to HDFS using Sqoop, Pig & Oozie for automating work flow.
• Perform structural modifications using Map-Reduce, HIVE and analyze data using visualization/ reporting tools.
• Hands on performance for improving techniques for data processing in Hive, Impala, Spark, Pig & Map-Reduce using methods dynamic partitioning, bucketing & file compression.
• Experience in extracting source data from Sequential files, XML files, CSV files, transforming and loading it into the target Data warehouse.
• Good knowledge on converting complex RDMS (Oracle, MySQL & Teradata) queries into Hive query language.
• My area of expertise has been on performing duties such as Analytics, Design, Data warehouse Modeling, Development, Implementation, Maintenance, Migration and Production support of large-scale Enterprise Data Warehouses.
• Well Exposure on Spark SQL, Spark Streaming and using Core Spark API to explore Spark features to build data pipelines with Spark batch process and did POC on Kafka-Spark streaming process.
• Hands on experience with Spark architecture and its integrations like Spark SQL, Data Frames.
• Experience in developing and scheduling ETL workflows in Hadoop using Oozie with the help of deployment and managing Hadoop cluster using Cloudera and Horton works.
• Experienced in installation, configuration, administration, troubleshooting, tuning, security, backup, recovery and upgrades of Cent OS, Red Hat Enterprise Linux (RHEL) operating systems in a large environment.
• Working knowledge of Hadoop, Hive, Sqoop, Pig, HBase & Oozie in real time environment and worked on many modules for performance improvements and architecture designing.
• Experience in layers of Hadoop Framework - Storage (HDFS), Analysis (Pig and Hive) &Engineering (Jobs and Workflows) for developing ETL processes to load data from multiple data sources to HDFS using Sqoop, Pig & Oozie for automating work flow.
• Perform structural modifications using Map-Reduce, HIVE and analyze data using visualization/ reporting tools.
• Hands on performance for improving techniques for data processing in Hive, Impala, Spark, Pig & Map-Reduce using methods dynamic partitioning, bucketing & file compression.
• Experience in extracting source data from Sequential files, XML files, CSV files, transforming and loading it into the target Data warehouse.
• Good knowledge on converting complex RDMS (Oracle, MySQL & Teradata) queries into Hive query language.
• My area of expertise has been on performing duties such as Analytics, Design, Data warehouse Modeling, Development, Implementation, Maintenance, Migration and Production support of large-scale Enterprise Data Warehouses.
• Well Exposure on Spark SQL, Spark Streaming and using Core Spark API to explore Spark features to build data pipelines with Spark batch process and did POC on Kafka-Spark streaming process.
• Hands on experience with Spark architecture and its integrations like Spark SQL, Data Frames.
• Experience in developing and scheduling ETL workflows in Hadoop using Oozie with the help of deployment and managing Hadoop cluster using Cloudera and Horton works.
• Experienced in installation, configuration, administration, troubleshooting, tuning, security, backup, recovery and upgrades of Cent OS, Red Hat Enterprise Linux (RHEL) operating systems in a large environment.
No comments:
Post a Comment