Junior Data Engineer Featured job

Posted time December 12, 2023 Location Remote Job type Full-time
  • Experience: 1+ years experience in a software development, data engineering, or data analytics field using Python, Scala, Spark, Java, or equivalent technologies.
The Jr Data Engineer at Koantek will have a working experience in languages like Python, SQL, Java/Scala or Spark. He/she will learn, get certified, and then use the knowledge of comprehensive modern data engineer techniques and methods with Advanced Analytics to support business decisions for our clients. Your goal is to support the use of data-driven insights to help our clients achieve business outcomes and objectives. You will help design and build data pipelines, data streams, reporting tools, information dashboards, data service APIs, data generators, and other end-user information portals and insight tools. You are expected to function as a productive member of a team, working and communicating proactively with engineering peers, technical lead, project managers, product owners, and resource managers .

Past job titles may have included: Python Developer, Java Developer, SQL Developer, Spark or Scala Developer

About the Company:

Reinvent the future of your business with Koantek, a cutting-edge technology service integrator. Our custom solutions redefine your operations, seamlessly managing migrations and unleashing the potential of artificial intelligence (AI) and machine learning (ML) to conquer even the most complex business challenge. Elevate Your Innovation with Koantek. We help you expertly piece together your technology puzzle, optimizing your ROI. Embrace the power of innovation with Koantek

Requirements

  • Hands-on experience in one or more of languages like Python, Java, SQL, Spark/Scala, PySpark
  • Knowledge of different programming and scripting languages like .NET, PowerShell etc
  • Working knowledge of code versioning tools [such as Git, Bitbucket or SVN] is a plus
  • Working knowledge of/on different Operating Systems like Linux, Unix, Windows etc.
  • Experience/Knowledge in creating tables, partitioning, bucketing, loading, and aggregating data using Spark SQL/PySpark
  • Working experience with Visual Studio, PowerShell Scripting, and ARM templates.
  • Needs to be a flexible, capable, and fast learner
  • Knowledge of Azure DevOps processes like CI/CD as well as Agile tools and processes including Git, Jenkins, Jira, and Confluence
  • Knowledge of Stream Analytics, Event/IoT Hubs, and Cosmos
  • Knowledge of Azure cloud and Data Lake and Analytics solutions on Azure.
  • Knowledge of Spark Architecture including Spark Streaming, Spark Core, Spark SQL, Data Frames, RDD caching, Spark MLib
  • Knowledge of data frameworks, data lakes and open-source projects such as Apache Spark, MLflow, and Delta Lake
  • Knowledge of using Spark SQL with various data sources like JSON, Parquet and Key Value Pair
  • Knowledge of different data stores (e. g., Azure Data Lake GEN2, Azure SQL Data Warehouse, Azure Blob Storage, HDFS) , messaging systems (e. g., Azure Event Hubs, Apache Kafka), and data processing engines (e. g., Azure Data Lake Analytics, Apache Hadoop, Apache Spark, Apache Storm, Azure HDInsight)
  • Knowledge of Big Data/analytics/information analysis/database management in the cloud
  • Ability to remain up to date with industry standards and technological advancements that will enhance data quality and reliability to advance strategic initiatives
  • Basic experience with or knowledge of agile methodologies

Responsibilities:

  • Learn and finish the assigned relevant training and get certified to become an Azure Databricks Engineer or an AWS Databricks Engineer
  •  Work closely with team members to learn, lead and drive enterprise solutions, advising on key decision points on trade-offs, best practices, and risk mitigation
  • Prepare codes for all modules according to required specification
  • Evaluate all functional requirements, map documents, and troubleshoot all development processes
  • Document all technical specifications and associates project deliverables.
  • Design all test cases to provide support to all systems and perform unit tests.

Qualifications:

  • 1+ years experience in a software development, data engineering, or data analytics field using Python, Scala, Spark, Java, or equivalent technologies.
  • Bachelor’s or Master’s degree in Big Data, Computer Science, Engineering, Mathematics, or similar area of study or equivalent work experience
  • Strong written and verbal communication skills
  • Ability to manage competing priorities in a fast-paced environment
  • Ability to resolve issues
  • Fast learner, Self-Motivated and ability to work independently
This job is Expired