Here is how to use Selenium to browse a page in Python.

2. Writing the Script

Create a Python script (e.g., selenium_wikipedia.py) and open it in your favorite code editor.

3. Example Script: Opening Wikipedia and Clicking a Link

Here is a complete example script that opens Wikipedia, searches for a term, and clicks on the first search result link:

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.chrome.service import Service
from webdriver_manager.chrome import ChromeDriverManager
import time
# Set up the Chrome WebDriver
service = Service(ChromeDriverManager().install())
driver = webdriver.Chrome(service=service)
try:
    # Open the Wikipedia homepage
    driver.get("https://www.wikipedia.org/")
    # Locate the search input field by its name attribute and enter a search term
    search_input = driver.find_element(By.NAME, 'search')
    search_input.send_keys('Selenium (software)')
    # Submit the search form
    search_input.send_keys(Keys.RETURN)
    # Wait for the results page to load and display the results
    time.sleep(2)
    # Click on the first search result link
    first_result = driver.find_element(By.CSS_SELECTOR, 'ul.mw-search-results li a')
    first_result.click()
    # Optional: Wait for a few seconds to ensure the page loads completely
    time.sleep(5)
    # Print the title of the current page
    print("Page title after click:", driver.title)
finally:
    # Close the browser
    driver.quit()

4. Running the Script

Run the script using your terminal or command prompt:

python selenium_wikipedia.py

5. Explanation of the Script

1. Setting Up WebDriver:

   • The script uses the webdriver_manager library to automatically manage the Chrome WebDriver.
   • It sets up the Chrome WebDriver using webdriver.Chrome(service=service).

2. Opening Wikipedia:

   • The script opens the Wikipedia homepage using driver.get("https://www.wikipedia.org/").

3. Searching for a Term:

   • The script locates the search input field by its name attribute using driver.find_element(By.NAME, 'search').
   • It enters the search term 'Selenium (software)' and submits the search form using search_input.send_keys(Keys.RETURN).

4. Clicking on the First Search Result:

   • The script waits for the search results page to load using time.sleep(2).
   • It locates the first search result link using driver.find_element(By.CSS_SELECTOR, 'ul.mw-search-results li a') and clicks on it.

5. Printing the Page Title:

   • The script waits for a few seconds to ensure the page loads completely using time.sleep(5).
   • It prints the title of the current page to verify that the click was successful using print("Page title after click:", driver.title).

6. Closing the Browser:

   • The script closes the browser using driver.quit().