커뮤니티
포인트
쿠폰
내 강의실
국비 신청 내역
증명서
계정
로그아웃
학습 질문
개발 일지
나의 활동
답변 완료
3-14 웹스크래핑 오류입니다.
undefined주차
북마크
문*민
댓글
12
추천
0
조회수
37
조회수
37
답변 완료



3-14 웹스크래핑 오류입니다.


일단 첫번째 문제는 pymongo랑 mongoclient인식이 안되는건지 빨간 느낌표가 자꾸뜹니다.

확인되지 않은 참조 'pymongo'

확인되지 않은 참조 'MongoClient'


두번째 문제는 아래 화면을 보셔야합니다.



스파르타 즉문즉답





작성한 코드 및 에러 메세지

import requests
from bs4 import BeautifulSoup


from pymongo import MongoClient
client = MongoClient('mongodb+srv://changmin:sparta@cluster0.ync24ej.mongodb.net/?retryWrites=true&w=majority')
db = client.dbsparta


headers = {'User-Agent' : 'Mozilla/5.0 (Windows NT 10.0; Win64; x64)AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36'}
data = requests.get('https://movie.naver.com/movie/sdb/rank/rmovie.naver?sel=pnt&date=20210829',headers=headers)

soup = BeautifulSoup(data.text, 'html.parser')

title = soup.select('#old_content > table > tbody > tr')

for movie in title:
    a = movie.select_one('td.title > div > a')
    b = movie.select_one('td:nth-child(1) > img')
    c = movie.select_one('td.point')
    if a is not None:
        doc = {
            'title': a,
            'rank':b['alt'],
            'star':c
        }
        db.movie.insert_one(doc)


오류메세지입니다. 아래는


"C:\Users\ckdal\OneDrive\바탕 화면\sparta\pythonprac\venv\Scripts\python.exe" "C:/Users/ckdal/OneDrive/바탕 화면/sparta/pythonprac/hello.py" 

Traceback (most recent call last):

 File "C:/Users/ckdal/OneDrive/바탕 화면/sparta/pythonprac/hello.py", line 27, in <module>

  db.movie.insert_one(doc)

 File "C:\Users\ckdal\OneDrive\바탕 화면\sparta\pythonprac\venv\lib\site-packages\pymongo\collection.py", line 621, in insert_one

  self._insert_one(

 File "C:\Users\ckdal\OneDrive\바탕 화면\sparta\pythonprac\venv\lib\site-packages\pymongo\collection.py", line 562, in _insert_one

  self.__database.client._retryable_write(acknowledged, _insert_command, session)

 File "C:\Users\ckdal\OneDrive\바탕 화면\sparta\pythonprac\venv\lib\site-packages\pymongo\mongo_client.py", line 1448, in _retryable_write

  return self._retry_with_session(retryable, func, s, None)

 File "C:\Users\ckdal\OneDrive\바탕 화면\sparta\pythonprac\venv\lib\site-packages\pymongo\mongo_client.py", line 1321, in _retry_with_session

  return self._retry_internal(retryable, func, session, bulk)

 File "C:\Users\ckdal\OneDrive\바탕 화면\sparta\pythonprac\venv\lib\site-packages\pymongo\_csot.py", line 105, in csot_wrapper

  return func(self, *args, **kwargs)

 File "C:\Users\ckdal\OneDrive\바탕 화면\sparta\pythonprac\venv\lib\site-packages\pymongo\mongo_client.py", line 1362, in _retry_internal

  return func(session, sock_info, retryable)

 File "C:\Users\ckdal\OneDrive\바탕 화면\sparta\pythonprac\venv\lib\site-packages\pymongo\collection.py", line 550, in _insert_command

  result = sock_info.command(

 File "C:\Users\ckdal\OneDrive\바탕 화면\sparta\pythonprac\venv\lib\site-packages\pymongo\pool.py", line 794, in command

  self._raise_connection_failure(error)

 File "C:\Users\ckdal\OneDrive\바탕 화면\sparta\pythonprac\venv\lib\site-packages\pymongo\pool.py", line 766, in command

  return command(

 File "C:\Users\ckdal\OneDrive\바탕 화면\sparta\pythonprac\venv\lib\site-packages\pymongo\network.py", line 127, in command

  request_id, msg, size, max_doc_size = message._op_msg(

 File "C:\Users\ckdal\OneDrive\바탕 화면\sparta\pythonprac\venv\lib\site-packages\pymongo\message.py", line 687, in _op_msg

  return _op_msg_uncompressed(flags, command, identifier, docs, opts)

bson.errors.InvalidDocument: cannot encode object: <a href="/movie/bi/mi/basic.naver?code=186114" title="밥정">밥정</a>, of type: <class 'bs4.element.Tag'>


종료 코드 1(으)로 완료된 프로세스





취소
 공유
취소
댓글 0
댓글 알림
나의얼굴