By lenartgolob
I have a web scrapper written in python with the library selenium that works on my local machine. When I push the data to my droplet, I cannot run that app. This is one of my web scrapping methods:
def defense_dash_lt10(pbp_stats, season):
# Less than 10 foot
url = 'https://www.nba.com/stats/players/defense-dash-lt10?Season=' + season
options = Options()
options.add_argument('--no-sandbox')
driver = webdriver.Chrome(service=ChromeService(
ChromeDriverManager().install()), options=options)
driver.get(url)
selects = driver.find_elements(By.CLASS_NAME, "DropDown_select__4pIg9 ")
for select in selects:
options = Select(select).options
for option in options:
if option.text == 'All':
option.click() # select() in earlier versions of webdriver
break
# Find the table element
table = driver.find_element(By.CLASS_NAME, 'Crom_table__p1iZz')
# Find all rows in the table
rows = table.find_elements(By.TAG_NAME, 'tr')
defense_dash_lt10 = []
# Loop through each row and extract the data from each cell
for row in rows:
player_dd_lt10 = []
# Find all cells in the row
cells = row.find_elements(By.TAG_NAME, 'td')
for cell in cells:
player_dd_lt10.append(cell.text)
# Add pbp stats to defense dash if not empty
if player_dd_lt10:
if player_dd_lt10[0] in pbp_stats:
defense_dash_lt10.append(player_dd_lt10 + pbp_stats[player_dd_lt10[0]][-2:])
else:
defense_dash_lt10.append(player_dd_lt10 + ['NaN', 'NaN'])
header = ['Player', 'Team', 'Age', 'Position', 'GP', 'Games', 'FREQ%', 'DFGM', 'DFGA', 'DFG%', 'FG%', 'DIFF%', "MP", "BLKR"]
return header, defense_dash_lt10
Become a contributor for community
Get paid to write technical tutorials and select a tech-focused charity to receive a matching donation.
DigitalOcean Documentation
Full documentation for every DigitalOcean product.
Resources for startups and AI-native businesses
The Wave has everything you need to know about building a business, from raising funding to marketing your product.
The developer cloud
Scale up as you grow — whether you're running one virtual machine or ten thousand.
Start building today
From GPU-powered inference and Kubernetes to managed databases and storage, get everything you need to build, scale, and deploy intelligent applications.
