Data  Engineer  (2-3 YEARS)- 5 POSITIONS,Rightpath Computer Technologies Pvt Ltd

WhatsApp Group Join Now
Telegram Group Join Now
  • Anywhere
  • Role: Data Engineer (2-3 YEARS)- 5 POSITIONSResponsibilities: Data Engineer will work on collecting, storing, processing, and analyzing huge sets of data The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company in various products. Key Skills: 1. Proficient understanding of distributed computing principles 2. Ability to build, run and manage large clusters 3. Hadoop v2, MapReduce, HDFS 4. Java, Python 5. Large Scale crawling : Scrapy, Nutch and custom crawling solutions 6. Experience with Apache Solr Lucene 7. NoSQL databases, such as MongoDB, HBase, Cassandra 8. Knowledge of various ETL techniques and frameworks, such as Flume 9. Experience with NLP tools and systems for POS, NER, and Information extraction 10. Experience with Machine Learning – Regression, Classification, Decision Trees. 11. Experience with Linux / AWS Key Technologies : – Web Scraping – NLP – NoSQL (MongoDB, Cassandra) – Python/JAVA, R – Machine Learning (Basics) – Big Data Tools (Hadoop, Spark, Pig, Hive)