Comments (2)
Hi there, in the README, it would be nice to include a runnable node example. Here is how I got it working:
// This is the main Node.js source code file of your actor.
// Import Apify SDK. For more information, see https://sdk.apify.com/
const Apify = require('apify');
Apify.main(async () => {
// Prepare actor input
/**
* Actor code
*/
const input = {
postsFromDate: "5 years",
searchKeywords: "bitcoin",
extendOutputFunction: async ({ data, item, page, request, customData }) => {
return item;
},
extendScraperFunction: async ({ page, request, requestQueue, customData, Apify, extendOutputFunction }) => {
},
customData: {},
proxyConfiguration: {
useApifyProxy: true
}
};
// Run the actor
const run = await Apify.call('bernardo/youtube-scraper', input,{'token':'<YOUR TOKEN>'});
// Print actor output (if any)
console.log('Output');
console.dir(run.output);
// Fetch and print actor results from the run's dataset (if any)
console.log('Results from dataset');
const dataset = await Apify.openDataset(run.defaultDatasetId, { forceCloud: true });
await dataset.forEach(async (item, index) => {
console.log(JSON.stringify(item));
});
});
from actor-youtube-scraper.
make sure you use await inside an async function, like this:
(async () => {
await ...
})()
top-level await is a feature that is only available in Node 14+
from actor-youtube-scraper.
Related Issues (20)
- Cannot read diacritics ("รก")
- Old videos are not scraped
- Multiple keyword search HOT 1
- how to capture the type of subtitles HOT 3
- How to go to the next page? HOT 1
- Getting-viewCount-failed - Raw error: waiting for XPath `//yt-view-count-renderer/span[1]` failed: timeout 120000ms exceeded HOT 1
- stealth mode failing HOT 2
- Gets stucked on video which are yet to be uploaded (concerts in the future)
- The time filter works lamely
- Actor gets stuck
- Node is either not visible or not an HTMLElement HOT 1
- Scraping subtitles HOT 1
- Add language the subtitles are in HOT 2
- Only 30 results and old videos missing HOT 1
- How to know which video belongs to which keyword?
- Result set not filtering correctly
- Multiple requests per video - ERROR PupeteerCrawler handleRequestFunction failed
- Collect total number of videos for a channel and retry if Google serves less videos
- Option for simplified output from scrolling that doesn't go to video details
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from actor-youtube-scraper.