DevOps Engineer- Experience with various messaging systems, such as Kafka or RabbitMQ.
Description
The Linux / Devops Admin will have a deep understanding of Java, Hadoop / Spark / Storm / No SQL / My SQL administration, security and troubleshooting. The Linux / Devops Admin will be an outstanding communicator, creative thinker, and data nerd.
- Responsible for implementation and ongoing administration of Big Data infrastructure
- Performance tuning of Big Data / cloud environment
- Troubleshooting (Very Important)
- Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Big Data and to expand existing environments.
- Working with data delivery teams to setup new users. This job includes setting up Linux users, setting up Kerberos principals and testing access for the new users.
- Cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios, Ambari and other tools.
- Screen cluster job performances and capacity planning
- Monitor cluster connectivity and security
- Manage and review log files.
- File system management and monitoring.
- SQL (No SQL such as Mongo or Cassandra / My SQL) support and maintenance.
- Collaborating with application teams to install operating system, updates, patches and version upgrades when required.
- Software installation and configuration.
- Database backup and recovery.
- Database connectivity and security.
- Disk Space Management.
- Motivated to work in start-up environment
Requirements
- Experience in cloud providers like AWS, Azure
- Experience in configuration management tool such as Ansible/Terraform
- Experience in CI/CD tool such as Jenkins.
- 1+ years of Experience / Knowledge of Java web/application servers, Big Data tools stack, NoSQL databases such as Hbase, Cassandra, MongoDB, Couch, Riak, Redis etc.
- Hadoop skills like Flink, Ranger, Kafka, HBase, Hive, Pig etc.
- Experience on deploying and managing big data and cloud applications to production environment.
- Administrative aspects of Big Data and Big Data Virtual Machines Azure, AWS or other cloud platforms
- Expertise in the following technologies: Core JAVA, Spring, Struts, JSP, Web-services, Gather and process raw data scale using scripts, web scraping, SQL queries, etc.
- Implementing ETL processes
- Experience with various messaging systems, such as Kafka or RabbitMQ.
- Understanding of Lambda Architecture along with its advantages and drawbacks will be a definite plus
- Should possess good analytical and interpersonal communication skills. Able to write and communicate effectively.
Position
DevOps Engineers
Salary
2 – 11 Lakh/Year INR
Expertise
- DevOps – 3 years
- AWS
- Azure
- Linux – 2 years
- Apache-Kafka
- Cassandra
- ElasticSearch
- Payroll
- Onsite
- Mumbai, Maharashtra, India
Originally Published At
Share this:
Share with
