Analysis and extraction of youtube data with python
$30-250 USD
Pagado a la entrega
Tasks:
Extraction:
1: We have to write the code in python for extracting the data which should be done in hadoop environment from youtube.
Ingestion:
2: We have to load the file from local to hdfs and create hive and impala tables.
3: Now load the data of hive and impala.
Analysis:
4: Segmentation: Load the data from Hive or Impala using pyspark
5: Create dataframe
6: Build Analysis like:
A: Number of users who see videos related to money deposit in banks.
B: Number of users who transfer money within same banks and to external bank accounts.
C: Segmentation: Find the location, age, number of comments, likes, feedback of users who see the videos.
It will be better if you setup cloudera environment from there we can do everything in python.
Nº del proyecto: #12697400
Sobre el proyecto
6 freelancers están ofertando un promedio de $178 por este trabajo
I have 9 years of exeperience in IT industry with more than 2.5 years of experience in hadoop technologies like Hive,Pig,Sqoop,Map Reduce,Hbase and Spark
i am good in hadoop , spark , hive , sqoop and python . i would like to start this work as soon as possible . hope we can proceed
Hello, I am applying for this job because I've a keen interest in BigData technology and I’m considering your job post for me with the required capabilities. I have learned Hadoop and its components Hive, Pig, Sqoop, Más
Hello, I can complete your requirement in given time. I am experineced python developer. Looking for your answer. Thanks, Jigar