6
Should I give up on getting a Bsc?
(programming.dev)
That's what I was thinking too. Thanks for the help.
Well, then I guess I'll worry about it if it becomes an issue.
Thank you. This seems very helpful.
This is both encouraging and scary. Not getting stuff right just intensifies my imposter syndrome when it comes to programming. But I understand what you mean. Just have to keep trying things and learn from my mistakes.
Thanks, this is really helpful advice.
AI can be ethically used in writing. This is not an example of that. People need to get into the "AI as a tool" mindset. And capitalism causing greed is part of the issue of course.
If this is for a job interview, Iโd err on the side of verbosity. Break it all into distinct, easy to read steps: load, process, output, logging, exception handling, comments, etc.
I turned it in days ago so there's nothing I can do about it. But I'll keep that in mind for the future.
Thanks, I set inplace=False like you suggested. I thought setting it to true meant that it modified the original dataframe. Why does it work with false?
I'm trying to do the job specs, but the net is just so wide. But yeah, it looks like personal projects is the way to go.
Currently working on the responsive web development course. I like the guitar sounds. ๐
14
Having trouble with web scraping. Help please.
(programming.dev)
- I was applying to a job, and then I had to answer a question about web scraping, which I'm not familiar with. I answered all the other questions with no issue, so I decided might as well put in the effort to learn the basics and see if I can do it in a day.
- Yes, it was *somewhat * easier than I expected, but I still had to watch like 4 YouTube videos and read a bunch of reddit and stack overflow posts.
- I got the code working, but I decided to run it again to double-check. It stopped working. Not sure why.
- Testing is also annoying because the "web page" is a google doc and constantly reloads or something. It takes forever to get proper results from my print statements.
- I attached an image with the question. I haven't heard back from them, and I've seen other people post what I think might be this exact question online, so hopefully I'm not doing anything illegal.
- At this point, I just want to solve it. Here's the code:
from bs4 import BeautifulSoup
import requests
import pandas as pd
import numpy as np
def createDataframe(url): #Make the data easier to handle
#Get the page's html data using BeautifulSoup
page = requests.get(url)
soup = BeautifulSoup(page.text, 'html.parser')
#Extract the table's headers and column structure
table_headers = soup.find('tr', class_='c8')
table_headers_titles = table_headers.find_all('td')
headers = [header.text for header in table_headers_titles]
#Extract the table's row data
rows = soup.find_all('tr', class_='c4')
row_data_outer = [row.find_all('td') for row in rows]
row_data = [[cell.text.strip() for cell in row] for row in row_data_outer]
#Create a dataframe using the extracted data
df = pd.DataFrame(row_data, columns=headers)
return df
def printMessage(dataframe): #Print the message gotten from the organised data
#Drop rows that have missing coordinates
dataframe = dataframe.dropna(subset=['x-coordinate', 'y-coordinate'], inplace=True)
#Convert the coordinate columns to integers so they can be used
dataframe['x-coordinate'] = dataframe['x-coordinate'].astype(int)
dataframe['y-coordinate'] = dataframe['y-coordinate'].astype(int)
#Determine how large the grid to be printed is
max_x = int(dataframe['x-coordinate'].max())
max_y = int(dataframe['y-coordinate'].max())
#Create an empty grid
grid = np.full((max_y + 1, max_x + 1), " ")
#Fill the grid with the characters using coordinates as the indices
for _, row in dataframe.iterrows():
x = row['x-coordinate']
y = row['y-coordinate']
char = row['Character']
grid[y][x] = char
for row in grid:
print("".join(row))
test = 'https://docs.google.com/document/d/e/2PACX-1vQGUck9HIFCyezsrBSnmENk5ieJuYwpt7YHYEzeNJkIb9OSDdx-ov2nRNReKQyey-cwJOoEKUhLmN9z/pub'
printMessage(createDataframe(test))
My most recent error:
C:\Users\User\PycharmProjects\dataAnnotationCodingQuestion\.venv\Scripts\python.exe C:\Users\User\PycharmProjects\dataAnnotationCodingQuestion\.venv\app.py
Traceback (most recent call last):
File "C:\Users\User\PycharmProjects\dataAnnotationCodingQuestion\.venv\app.py", line 50, in <module>
printMessage(createDataframe(test))
File "C:\Users\User\PycharmProjects\dataAnnotationCodingQuestion\.venv\app.py", line 30, in printMessage
dataframe['x-coordinate'] = dataframe['x-coordinate'].astype(int)
~~~~~~~~~^^^^^^^^^^^^^^^^
TypeError: 'NoneType' object is not subscriptable
Process finished with exit code 1
Sounds like they're still very relevant and very important. Python isn't a language I've used a lot but I'm still surprised I've never heard about docstrings till this tutorial. Thanks for the info.
view more: next โบ
3rr4tt1c
0 post score0 comment score
joined 1 year ago
I've legit thought about this. But starting in an entirely different field is daunting.