Azure: Customize data factory for delta logic

€8-30 EUR

Cerrado

Publicado

hace más de 1 año

€8-30 EUR

Pagado a la entrega

Two new columns are required in the Postgres database for this purpose: Datahash LastModified A hash is stored in Datahash, which is calculated from all columns except for Datahash and LastModified. When transferring the data from Conceptum, the method should be adjusted: Calculate hash from new data Compare new hash with old If matching, data hash, and LastModified do not change Otherwise, insert a new hash into the data hash and set LastModified to the current time (now). Use new data from Conceptum

ID del proyecto: 35355169

Información sobre el proyecto

3 propuestas

Proyecto remoto

Activo hace 1 año

¿Buscas ganar dinero?

Dirección de email

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto

Cobra por tu trabajo

Describe tu propuesta

Es gratis registrarse y presentar ofertas en los trabajos

3 freelancers están ofertando un promedio de €38 EUR por este trabajo

@patilpk153

Experienced in Azure and Azure data factory, need to check on how to best achieve this requirement

€39 EUR en 4 días

4,9

(5 comentarios)

3,2

@perfomancedev

Greetings! Thanks for your job posting. I read your project details and i understood all. I can help you with your project at a high level! I have rich experience in Azure developing. My skills and experience is a great match for your needs. I can start right now. Looking forward to hearing from you. Best regards. thanks.

€50 EUR en 2 días

0,0

(0 comentarios)

0,0

@tirthodebnath

I can build a smooth ETL pipeline that can help extract data from any source system(eg: Hive Database, Relational database server) hosted in any cloud platforms(eg: GCP, AWS, AZURE) & on premice servers also. The pipelines can also handle transformations and modifications of data as per requirement, and lastly the filter data will be stored in the desired database / data warehouse. For transformation and modification I use Azure Data Bricks notebook, and for orchestrating and monitoring the ETL pipeline I use Azure Data Factory. And for visualization purpose I use Azure Synaps to connect with the any visualization tools(eg: Power BI, Tablue, MSTR). But I would like to know more about the project. If possible I am ready to discuss about this over a zoom or google meet. I work as a Data engineer where I have build various pipelines as per client requirements and delivered successfully to the clients.

€25 EUR en 7 días