Skip to content

HOWTO.md

Latest commit

聽

History

History
51 lines (39 loc) 路 1.3 KB

HOWTO.md

File metadata and controls

51 lines (39 loc) 路 1.3 KB
Raw

袣芯屑锌懈谢褟褑懈褟 Cython

  1. 袛谢褟 泻芯屑锌懈谢褟褑懈懈 cython-褋泻褉懈锌褌芯胁 胁 Linux 胁邪屑 锌芯薪邪写芯斜懈褌褋褟 褍褋褌邪薪芯胁懈褌褜 薪械泻芯褌芯褉褘械 蟹邪胁懈褋懈屑芯褋褌懈

    apt install build-essential
# 锌芯屑械薪褟泄褌械 薪邪 懈褋锌芯谢褜蟹褍械屑褍褞 胁邪屑懈 胁械褉褋懈褞
apt install python3.8-dev
pip3 install cython --upgrade

  2. 谐械薪械褉懈褉褍械屑 C-褎邪泄谢

    cython3 -D --embed -3 -o <scriptname>.c <scriptname>.pyx

  3. 泻芯屑锌懈谢懈褉褍械屑 斜懈薪邪褉薪懈泻

    # 锌芯屑械薪褟泄褌械 薪邪 懈褋锌芯谢褜蟹褍械屑褍褞 胁邪屑懈 胁械褉褋懈褞
gcc -Os -I /usr/include/python3.8 -o <scriptname> <scriptname>.c -lpython3.8 -lpthread -lm -lutil -ldl

  4. 屑芯卸薪芯 蟹邪锌褍褋泻邪褌褜

    ./<scriptname>

校褋褌邪薪芯胁泻邪 泻芯薪褌械泄薪械褉芯胁 写谢褟 MapReduce

  1. 小泻邪褔邪褌褜 docker-compose

    git clone https://github.com/pimiento/mapreduce-example-infra.git
cd mapreduce-example-infra

  2. 校褋褌邪薪芯胁懈褌褜 泻芯薪褌械泄薪械褉褘

    docker-compose up -d

  3. 袟邪泄褌懈 薪邪 NameNode

    docker exec -it namenode bash

  4. 袙褘锌芯谢薪懈褌褜 泻芯写

    ./run_mapreduce.sh