Auto-translation used

Will AI replace Data Engineers?

No, but the profession will change!

Alexey Dral, the founder of the BigData Team, mentioned this in his speech at the WDS conference.:

"The key task of a Data engineer is to solve the issue of data consistency. At the dawn of computer development, the Data Engineer (DE) solved the issue of cache coherence. Then the first databases appeared, and DE was responsible for setting up transaction isolation. For the past twenty years, DE has been addressing issues of data consistency within a single cluster (intra-cluster consistency). It is only in the last five years that we have reached the issues of inter-cluster consistency. It is important for a Data engineer to understand where 100% consistency of data is needed, and where requirements can be relaxed. So, when making transactions in a bank, the data must always be accurate, and when calculating views, the approximate figure will have little effect. New technologies, frameworks, databases, paradigms, and programming languages are emerging to address these issues. But the average lifetime of a new technology in IT is about 1.5 years. Therefore, the key task will not go away, but the profession will really change."

In our Big Data courses, we combine fundamental knowledge and new technologies. Also, pay attention to the previously published questions for preparing for the interview for the role of DE.

BigData Team: the way you learn best

#study #work #opinions

Comments 0

Login to leave a comment