Skip to content

Python_Package.md

Latest commit

 

History

History
249 lines (182 loc) · 7.6 KB

Python_Package.md

File metadata and controls

249 lines (182 loc) · 7.6 KB

pip install tensorflow torch torchvision keras scikit-learn xgboost catboost lightgbm scipy nltk spacy gensim textblob vaderSentiment transformers numpy pandas polars pyspark findspark pyarrow matplotlib seaborn plotly bokeh dash streamlit taipy folium ipyvizzu ipyvizzu-story ipywidgets opencv-python pillow imageio colour librosa audioflux pydub requests urllib3 beautifulsoup4 scrapy fastapi flask django jupyterlab notebook jupytext mkdocs pytest unittest2 black pylint tqdm progress colorama simplejson python-dateutil pendulum emoji prettytable beautifultable tabulate ipython networkx geopy geopandas kaggle pygame arcade

  • pip freeze > requirements.txt

Python Package Reference by Category

This document groups popular Python libraries by category. Each entry includes a short description, install command, and update command.

Deep Learning

  • TensorFlow: Google’s deep learning framework.

    • Install: pip install tensorflow
    • Update: pip install --upgrade tensorflow

  • PyTorch: Facebook’s deep learning framework.

    • Install: pip install torch torchvision
    • Update: pip install --upgrade torch torchvision

  • Keras: High-level neural networks API (now integrated with TensorFlow).

    • Install: pip install keras
    • Update: pip install --upgrade keras

Machine Learning

  • Scikit-learn: General ML algorithms and utilities.

    • Install: pip install scikit-learn
    • Update: pip install --upgrade scikit-learn

  • XGBoost: Gradient boosting library.

    • Install: pip install xgboost
    • Update: pip install --upgrade xgboost

  • CatBoost: Gradient boosting optimized for categorical features.

    • Install: pip install catboost
    • Update: pip install --upgrade catboost

  • LightGBM: Fast gradient boosting by Microsoft.

    • Install: pip install lightgbm
    • Update: pip install --upgrade lightgbm

  • SciPy: Scientific computing library.

    • Install: pip install scipy
    • Update: pip install --upgrade scipy

Natural Language Processing (NLP)

  • NLTK: Natural language toolkit.

    • Install: pip install nltk
    • Update: pip install --upgrade nltk

  • spaCy: Industrial-strength NLP.

    • Install: pip install spacy
    • Update: pip install --upgrade spacy

  • Gensim: Topic modeling and vector space modeling.

    • Install: pip install gensim
    • Update: pip install --upgrade gensim

  • TextBlob: Simplified NLP.

    • Install: pip install textblob
    • Update: pip install --upgrade textblob

  • VaderSentiment: Rule-based sentiment analysis.

    • Install: pip install vaderSentiment
    • Update: pip install --upgrade vaderSentiment

  • Transformers: HuggingFace models for NLP.

    • Install: pip install transformers
    • Update: pip install --upgrade transformers

Data Manipulation and Analysis

  • NumPy: Numerical arrays.

    • Install: pip install numpy
    • Update: pip install --upgrade numpy

  • Pandas: Data analysis and manipulation.

    • Install: pip install pandas
    • Update: pip install --upgrade pandas

  • Polars: Fast DataFrame library in Rust.

    • Install: pip install polars
    • Update: pip install --upgrade polars

  • PySpark: Distributed data processing.

    • Install: pip install pyspark
    • Update: pip install --upgrade pyspark

  • Findspark: Utility to run PySpark easily.

    • Install: pip install findspark
    • Update: pip install --upgrade findspark

Visualization

  • Matplotlib: Plotting library.

    • Install: pip install matplotlib
    • Update: pip install --upgrade matplotlib

  • Seaborn: Statistical data visualization.

    • Install: pip install seaborn
    • Update: pip install --upgrade seaborn

  • Plotly: Interactive graphs.

    • Install: pip install plotly
    • Update: pip install --upgrade plotly

  • Bokeh: Interactive visualizations for the web.

    • Install: pip install bokeh
    • Update: pip install --upgrade bokeh

  • Dash: Dashboarding with Plotly.

    • Install: pip install dash
    • Update: pip install --upgrade dash

  • Streamlit: Interactive apps.

    • Install: pip install streamlit
    • Update: pip install --upgrade streamlit

  • Taipy: Workflow and visualization.

    • Install: pip install taipy
    • Update: pip install --upgrade taipy

  • Folium: Maps and geospatial visualization.

    • Install: pip install folium
    • Update: pip install --upgrade folium

  • IpyVizzu: Create animated data visualizations inside Jupyter or IPython.

    • Install: pip install ipyvizzu
    • Update: pip install --upgrade ipyvizzu

  • IpyVizzu-Story (optional): Build animated data stories with Vizzu.

    • Install: pip install ipyvizzu-story
    • Update: pip install --upgrade ipyvizzu-story

Image Processing

  • OpenCV: Computer vision.

    • Install: pip install opencv-python
    • Update: pip install --upgrade opencv-python

  • Pillow (PIL): Image processing.

    • Install: pip install pillow
    • Update: pip install --upgrade pillow

  • ImageIO: Image input/output.

    • Install: pip install imageio
    • Update: pip install --upgrade imageio

  • Colour: Color science.

    • Install: pip install colour
    • Update: pip install --upgrade colour

Audio Processing

  • Librosa: Audio analysis.

    • Install: pip install librosa
    • Update: pip install --upgrade librosa

  • AudioFlux: Deep learning for audio.

    • Install: pip install audioflux
    • Update: pip install --upgrade audioflux

  • Pydub: Audio file manipulation.

    • Install: pip install pydub
    • Update: pip install --upgrade pydub

Web and APIs

  • Requests: HTTP library.

    • Install: pip install requests
    • Update: pip install --upgrade requests

  • urllib3: Lower-level HTTP client.

    • Install: pip install urllib3
    • Update: pip install --upgrade urllib3

  • BeautifulSoup4: HTML parsing.

    • Install: pip install beautifulsoup4
    • Update: pip install --upgrade beautifulsoup4

  • Scrapy: Web scraping framework.

    • Install: pip install scrapy
    • Update: pip install --upgrade scrapy

  • FastAPI: High-performance API framework.

    • Install: pip install fastapi
    • Update: pip install --upgrade fastapi

  • Flask: Lightweight web framework.

    • Install: pip install flask
    • Update: pip install --upgrade flask

  • Django: Full-featured web framework.

    • Install: pip install django
    • Update: pip install --upgrade django

Documentation and Notebooks

  • JupyterLab: Next-gen Jupyter environment.

    • Install: pip install jupyterlab
    • Update: pip install --upgrade jupyterlab

  • Notebook: Classic Jupyter interface.

    • Install: pip install notebook
    • Update: pip install --upgrade notebook

  • Jupytext: Sync Jupyter notebooks with scripts.

    • Install: pip install jupytext
    • Update: pip install --upgrade jupytext

  • MkDocs: Documentation generator.

    • Install: pip install mkdocs
    • Update: pip install --upgrade mkdocs

Testing and Code Quality

  • Pytest: Testing framework.

    • Install: pip install pytest
    • Update: pip install --upgrade pytest

  • Unittest2: Extended unit testing.

    • Install: pip install unittest2
    • Update: pip install --upgrade unittest2

  • Black: Code formatter.

    • Install: pip install black
    • Update: pip install --upgrade black

  • Pylint: Code linter.

    • Install: pip install pylint
    • Update: pip install --upgrade pylint

Utilities

  • TQDM: Progress bars.