Freelancer Needed for Scalable YouTube Creator Tracking and Keyword Database System
Description:
We are seeking a skilled freelancer to turn our MVP code into a scalable system that tracks YouTube creators for a comprehensive keyword database. The goal is to create an automated, reliable solution that scans YouTube monthly for the top 100,000 creators associated with each keyword in our database.
Project Requirements:
1) Scalable System Design:
Transform existing MVP code into a system that searches each keyword from our ?All cooking keywords? Google Sheet and identifies the top 10 creators per keyword.
Ensure the system can handle a significant increase in keywords without overloading the YouTube API quota.
Database Setup & Storage in BigQuery:
2) Set up Google BigQuery to store and organize the resulting creator data monthly.
Ensure BigQuery tables are organized by keyword, creator details, engagement metrics, etc., for efficient querying and analysis.
Provide guidance on monthly costs associated with storage and querying based on 100,000 entries.
API Management:
3) Advise on the optimal number of YouTube API keys needed to handle monthly data loads within quota limits.
Implement efficient API key rotation and error handling.
Cloud Automation & Scheduling:
Automate the code to run monthly using Google Cloud Functions or Cloud Run.
Integrate logging and monitoring for system health, API usage, and any quota issues.
Output Requirements:
Output to a Google BigQuery table for analysis, with fields such as channel ID, title, subscribers, views, country, and keyword.
Maintain user-friendly table organization for easy analysis and trend monitoring.
Cost Estimation:
Provide a detailed estimation of Google BigQuery costs, including storage and query costs for a high volume of data.
Skills Required:
Experience with YouTube Data API and API quota management.
Proficiency with Google Cloud Platform, BigQuery, Cloud Functions, and Cloud Run.
Python coding and experience with Google Sheets API and OAuth for authentication.
Strong understanding of scalable data processing and storage solutions.
Deliverables:
Fully automated, scalable code in Python.
Structured BigQuery tables for efficient querying.
Documentation on system operation, cost estimates, and error handling.
This is a long-term project with potential monthly work if the system operates well. Please provide relevant experience, estimated timeline, and a brief description of your approach to this project.
Similar Remote Jobs
Freelancer Needed for Scalable YouTube Creator Tracking and Keyword Database System
Posted on: 30-11-2024 09:46
CVS Remote Careers (Remote Data Entry Jobs) ? Open Positions Available
Posted on: 30-11-2024 09:46
FedEx Remote Jobs ? No Experience ? Work From Home Jobs
Posted on: 30-11-2024 09:46
Remote Data Entry Jobs with American Express: Work from Home Opportunity
Posted on: 30-11-2024 09:46
Netflix Remote (Data Entry Jobs) $21/H ? [Entry level remote jobs]
Posted on: 30-11-2024 09:46
IT Systems Engineer / North America / Canada / Fully Remote
Posted on: 30-11-2024 09:46
Amazon Virtual Assistant Job @ Latest Job For USA ? MySmartPros
Posted on: 30-11-2024 09:46
Senior Accountant - Enterprise Sarbanes Oxley (SOX) Internal Controls - Hybrid
Posted on: 30-11-2024 09:46
Medical Biller/Intake Specialist - Experienced - Remote | DME Experience Preferred
Posted on: 30-11-2024 09:46
REMOTE Senior Tax Advisor, for Small and Growing Firm (Flexible Hours)
Posted on: 30-11-2024 09:46
Remote Customer Service Representative
Posted on: 07-09-2024 00:00
Amazon Data Entry Jobs (At Work Home) Apply Now [Remote Part-time jobs]
Posted on: 14-02-2025 07:17
Walgreens Careers Data Entry No Experience Remote ? CA
Posted on: 06-11-2024 04:54
American Express Remote Jobs (Virtual Assistant) $33/Hr
Posted on: 31-07-2024 19:11
Apple Home Advisor Customer Support at Apple
Posted on: 12-09-2024 00:00
Walmart Data Entry Work From Home Jobs - No Experience
Posted on: 16-07-2024 18:41
Product tester
Posted on: 16-07-2024 18:51
Part-Time Customer Service Agent – Paid Leave – Los Angeles
Posted on: 12-09-2024 00:00
Delta data entry jobs
Posted on: 16-07-2024 18:53
3rd Shift Operator M-F 11:00pm-7:30am $18.71
Posted on: 11-08-2024 00:00