All Questions
Tagged with selenium-webdriver web-scraping
8,421
questions
-1
votes
0
answers
13
views
Python selenium webscraping recaptcha
I want to scrape a website but before that there is a recaptcha and I even got the data using api,and i also injected it into the website as the webpage has no submit button I couldn't submit. the ...
-4
votes
1
answer
30
views
Best approach to simulate purchases for stock level information using Python and Selenium [closed]
I'm developing a web scraping service, primarily focusing on the fashion industry. My goal is to provide comprehensive data about products, including their stock levels. To achieve this, I need to ...
0
votes
1
answer
20
views
Dynamic Web scaping with Selenium not working on TAMU dining website
I am creating a web-scraping API that will scrape my university's dining hall website and pull the food items that are currently offered depending on the time of day. Currently, the web scraper is not ...
-1
votes
0
answers
21
views
Python selenium skips random amount of questions in a quiz
from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.chrome.service import Service
from selenium.webdriver.support import expected_conditions as EC
import ...
0
votes
0
answers
21
views
Message: session not created from unknown error: cannot find Chrome binary
On my Ubuntu server 22.04.4, I installed Python, Selenium, Chrome, Chromedriver and when I tried to run my script I got some errors.
We have the 126.0.6478.126 Chrome version and also the 126.0.6478....
0
votes
0
answers
10
views
Scroll Instagram Followers Box Selenium Python
Tried all existing answers and seem to be out dated.
I'm trying to scroll down on the list. The driver finds the dialog box but for some reason it doesn't scroll, I've tried multiple scripts and none ...
- 23
0
votes
0
answers
15
views
Scraping Amazon Shopping Cart in Real time via a chrome extension
I am trying to build a chrome extension that in real time scrapes the amazon website as the user is on it and gets us the subtotal in the user's cart before they proceed to checkout. We will use this ...
1
vote
1
answer
56
views
Scraping text in whitebox
I am trying to collect some Dutch historical election data. Below you see the code I have been using. I still need to figure out how to iterate the process for every 'Gemeente', but my main problem ...
- 115
-1
votes
0
answers
18
views
Scrape live appearing elements
So i have a website i am scraping data off, and it has live appearing elements i need to keep getting. I see them on screen and can get them as html via inspect. However i've been searching for hours ...
- 1
0
votes
0
answers
21
views
Selenium XPATH for Google general search - how to improve results
I wrote a Python program to run a Google search for each company name in an Excel sheet. However, I get a lot more search results when manually searching the company names up on google.
I suspect it's ...
- 27
0
votes
3
answers
69
views
Selenium isn't recognizing a button on my webpage
I am trying to automate the data entry for a project I'm working on by making a selenium code to pull all of the data from a survey report page. My current issue is that for some reason one of the ...
-1
votes
1
answer
62
views
How I do scraping in a web page that show information with scroll and not with index?
I'm learning web scraping, and i'm trying to get data from a page that show information with scroll, What can I do in this scenario?, Is there a function to make the entire page load? I am using ...
0
votes
0
answers
22
views
Utilizing Artificial Intelligence for Location Data Collection from Websites [closed]
I have a project where I need to collect information about some locations from certain websites. Initially, I used a web scraper and utilized Selenium and Beautiful Soup to write a bot. However, some ...
-1
votes
1
answer
27
views
How to get username for top posts for a certain keyword using selenium in python
Trying to get to the top posts for a keyword on instagram and capture their username and save it into a csv. Since the username is only displayed when the post is clicked I am unable to find the ...
- 143
0
votes
1
answer
50
views
How do I use this Webscrape table with Selenium?
I need a solution for scaping tables. Currently getting a TimeoutException: Message:
driver = webdriver.Chrome('C:\Drivers\chromedriver.exe')
waitWD = WebDriverWait (driver, 10)
link = "https://...
