Data Engineer
About the Role
Data Engineer’s prepare secure data for analytical or operational uses by moving data and pulling together information from different files or systems, integrating, consolidating and cleansing the data; and structuring it for use in individual analytics applications. A Data Engineer is responsible for finding upward or downward trends in data sets and developing algorithms which help make raw data more useful to businesses making informed decisions.
Data engineers work together with data architects, data analysts, and data scientists.
Key Industries for employment opportunities are extremely broad ranging from and not limited to: Information Technology & Services, Government, Computer Software, Banking & Financial Services, Hospital & Health Care.
Salary Expectation: $120,000 – $140,000
Qualifications, Training, Licenses
Bachelor’s or Master’s degree in Computer Science or related IT discipline such as, Engineering, Data, Computer Science and Analytics.
Completion of industry-recognised specialisation certifications is beneficial (e.g GCP).
Knowledge & Capabilities
Proficiency in programming language to code the ETL or data pipeline framework.
Expert level experience in scripting languages such as SQL, Bash, Python or Spark Scala.
Able to collect, manipulate and convert data.
Develop, construct, test and maintain data architecture (data structures) and data warehousing (electronic storage of information).
Align architecture with business requirements.
Able to identify ways of improving the reliability, efficiency and qualities of data and find hidden patterns using data.
Conduct research for businesses and use data sets to address business issues and deliver analytics to stakeholders.
Deploy analytics programs, machine learning concept and statistical methods.
Prepare data for predictive and prescriptive modeling and able to use data to discover any tasks which can be automated.
World Capabilities
Data Agile
Change Engager
Critical Thinker
Life-long Learner
Pathway - Formal
Bachelor’s or Master’s degree in Computer Science, or related IT discipline.
