Python Package for Data Scraping
9 July, 2020 by
Python Package for Data Scraping
PT. KIN SOFT INDONESIA, Admin Kinsoft
1. Requests Package
import requests
2. LXML Package
from lxml import html 
3. Regex Package
import re
4. JSON Package
import json
5. CSV Package
import csv
6. Click Package
import click
7. Package for Connect to mongodb database
pipenv install pymongo

from pymongo import MongoClient


8. Package for join url
from urllib.parse import urljoin
9. Package for Fake User Agent in a browser
pipenv install fake-useragent

from fake_useragent import UserAgent
Python Package for Data Scraping
PT. KIN SOFT INDONESIA, Admin Kinsoft
9 July, 2020
Share this post
Archive