python - How to login in a website While web scraping

Question

I am making a web scraper that can bring back my YouTube channel stats in python , so I went to my YT studio site and copied the link and pasted it print the soup using bs4.I took the whole test that was printed and created an html file and when i looked at it , it was the YouTube login page.

So now i want to login into this(lets say i can provide the password and email id in a text file) in order to scrape the yt studio stats.I have no idea bout this (im new to web scraping)

question from:https://stackoverflow.com/questions/65867478/how-to-login-in-a-website-while-web-scraping

Answer 1

you can use youTubeAPI to perform your operation. If you are still looking for a method to perform via web scraping below is the code for it

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.common.keys import Keys

driver= webdriver.Chrome('')
driver.get('https://accounts.google.com/signin')

driver.find_element(By.XPATH,'//*[@id="identifierId"]').send_keys('[email protected]');

driver.find_element(By.XPATH,'//*[@id="identifierNext"]/div/button').click();

driver.findElement(By.id("passwordNext")).click();

While doing via web scraping after entering an email address and trying to enter the password field, you may come across an error like below. It will happen because of multiple reasons like two-factor auth, not the secure browser.

you can disable two-factor auth for your login and give it a try with web scraping it will help