Skip to content

Commit 019de39

Browse files
feat(linkedin): adapt to the new html (#122)
1 parent 95463d1 commit 019de39

4 files changed

Lines changed: 41 additions & 20 deletions

File tree

e2e/__snapshots__/scrappers.test.ts.snap

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -380,16 +380,16 @@ Senior Frontend Developer Spinks Lisbon, Portugal (Hybrid) https://www.linkedin.
380380

381381
exports[`RowsX - scrappers tests Scrapping - linkedin-search-people 1`] = `
382382
"Avatar Name Job Location Profile url
383-
=IMAGE("https://media.licdn.com/dms/image/C4E03AQH07GJ8dLm07A/profile-displayphoto-shrink_100_100/0/1582636213281?e=1711584000&v=beta&t=crNJgxo5FVDBzQR0Pberds2L2JEFG62Z7KVIxJhOTO0") Nuno Veloso Head of Engineering at FARFETCH Porto Metropolitan Area https://www.linkedin.com/in/nveloso
384-
=IMAGE("https://media.licdn.com/dms/image/D4D03AQFG6JYq4SkJrA/profile-displayphoto-shrink_100_100/0/1676977343592?e=1711584000&v=beta&t=j8jFUNLFooXPLOSSFH73fYdfnLrSe3ogh0vXerpqz9s") Mariana Gomes Product Design Lead | ex-MetaLab | prev Lead Designer @Rows Porto Metropolitan Area https://www.linkedin.com/in/marianasrgomes
385-
=IMAGE("https://media.licdn.com/dms/image/C4E03AQH2SzQEEmz2dQ/profile-displayphoto-shrink_100_100/0/1608721946513?e=1711584000&v=beta&t=lOZoH48EuRVsktudmQg8yC1oHf2Nm__fLRjZ_2WgeCg") Vania Pinto Correia Head of People at Translucent Porto https://www.linkedin.com/in/vania-pinto-correia
386-
=IMAGE("https://media.licdn.com/dms/image/C5603AQHL5GtkRBMXrQ/profile-displayphoto-shrink_100_100/0/1624445216803?e=1711584000&v=beta&t=BiXzDT4lbNakO8bGoN5wy5OnOXy1EWBiIx3PE3EAtaQ") Álvaro Samagaio Co-Host at Founder Tales Podcast | Growth and Data at Rows | Primus Inter Pares 2021 Winner | Biomedical Eng. Porto Metropolitan Area https://www.linkedin.com/in/alvarosamagaio
387-
=IMAGE("https://media.licdn.com/dms/image/C4E03AQFznf1RlVnaoA/profile-displayphoto-shrink_100_100/0/1631964992025?e=1711584000&v=beta&t=5harvi1GA2pQinrf_aPRxBqaz8ON4J_I-YRIMvPyBAM") Miguel Freitas Product Designer @ Rows Porto https://www.linkedin.com/in/miguelmfreitas
388-
Tiago Cardoso Software Engineer at Rows Portugal https://www.linkedin.com/in/tiagobluemelcardoso
389-
=IMAGE("https://media.licdn.com/dms/image/C4D03AQGVMsRxeiNDuQ/profile-displayphoto-shrink_100_100/0/1516894399474?e=1711584000&v=beta&t=q2Qkm-irKU4qRcAQd3JsFZo86iTEsFzP_7q6ljiG3bM") João Caxias Silva Analytics Engineer Maia https://www.linkedin.com/in/jcaxias
390-
=IMAGE("https://media.licdn.com/dms/image/C4D03AQFN_iKplP0Daw/profile-displayphoto-shrink_100_100/0/1614075170531?e=1711584000&v=beta&t=x-xd_ANe72Zp85-9uykow2wgE4SId-E-XFCnsEixfxo") Bruno Sotto-Mayor Pinto Frontend Developer at Rows Porto https://www.linkedin.com/in/brpinto
391-
=IMAGE("https://media.licdn.com/dms/image/C4E03AQGd7fTteAFuWQ/profile-displayphoto-shrink_100_100/0/1516274284771?e=1711584000&v=beta&t=bFwU54fBF_4ZcGIIURVh8sIoECJyGCYaWU5-cBvOzhI") Rui Maranhao Abreu Research Software Engineer @ Meta & Professor of Software Engineering @ U.Porto San Francisco Bay Area https://www.linkedin.com/in/ruimaranhao
392-
=IMAGE("https://media.licdn.com/dms/image/C4E03AQFNQOVNKdPT6Q/profile-displayphoto-shrink_100_100/0/1517478935400?e=1711584000&v=beta&t=WiOfYeX-v8tyw9hTtSk6VCMOnbBy_YTuoqsEmvLDtpw") Pedro Ferreira Senior Backend Engineer na Rows Porto Metropolitan Area https://www.linkedin.com/in/pedro-ferreira-010982a7"
383+
=IMAGE("https://media.licdn.com/dms/image/v2/D4D03AQFN0ccgRQ2rCw/profile-displayphoto-shrink_100_100/profile-displayphoto-shrink_100_100/0/1722274955089?e=1741824000&v=beta&t=Dn7xKcr3s57c-m5YV3104y-R_dMNI-xGdDO4V1Xli3E") Pedro Pereira Senior Software Engineer - Dapps Porto Metropolitan Area https://www.linkedin.com/in/pedro-pereira-b2b04236
384+
=IMAGE("https://media.licdn.com/dms/image/v2/D4D03AQFG6JYq4SkJrA/profile-displayphoto-shrink_100_100/profile-displayphoto-shrink_100_100/0/1676977343592?e=1741824000&v=beta&t=vQCX7tTCtmpsEUScxxBuH3Y1yXxZLVZBz05mjmogjz0") Mariana Gomes Lead Product Designer | ex-MetaLab Porto Metropolitan Area https://www.linkedin.com/in/marianasrgomes
385+
=IMAGE("https://media.licdn.com/dms/image/v2/D4D03AQEHMuHHb1HQrw/profile-displayphoto-shrink_100_100/profile-displayphoto-shrink_100_100/0/1724232062313?e=1741824000&v=beta&t=XRf9MSHP_cRRSqBfWTd_l55mnPD0LnnXfUn-72f502U") Tiago Andrade Product Designer at Motion Porto https://www.linkedin.com/in/tiagovandrade
386+
=IMAGE("https://media.licdn.com/dms/image/v2/C4E03AQFCwWGQBw1Vbg/profile-displayphoto-shrink_100_100/profile-displayphoto-shrink_100_100/0/1517695524467?e=1741824000&v=beta&t=aihTsgaD95DEyJNPgLrMAcg9WjtDh5hJxpvj0h9E054") Pedro Trabulo Senior Software Engineer Braga https://www.linkedin.com/in/trabulo
387+
=IMAGE("https://media.licdn.com/dms/image/v2/C4D03AQGVMsRxeiNDuQ/profile-displayphoto-shrink_100_100/profile-displayphoto-shrink_100_100/0/1516894399474?e=1741824000&v=beta&t=ZHteYWgjMzENO-G6fFoB9DRGb4yUYKLBSxJmHnEnNsE") João Caxias Silva Analytics Engineer Maia https://www.linkedin.com/in/jcaxias
388+
=IMAGE("https://media.licdn.com/dms/image/v2/C5603AQG6OyL90-lDLQ/profile-displayphoto-shrink_100_100/profile-displayphoto-shrink_100_100/0/1560353663382?e=1741824000&v=beta&t=ApoQWZr4fh60jY9uOSnMjHEHL1nfk6Mo4AV0v_nVF5Y") Dominik Cholewski Staff Technical Writer at Belvo Porto https://www.linkedin.com/in/dominik-cholewski
389+
=IMAGE("https://media.licdn.com/dms/image/v2/C5603AQFc7aX_mHJE_w/profile-displayphoto-shrink_100_100/profile-displayphoto-shrink_100_100/0/1517723786288?e=1741824000&v=beta&t=QizGcNCDyHVcqewFhoF37T2IZPeYH6FP2Bqh8sIbz1s") Michail Karamanos Principal Engineer - Big Data 🥋 Aveiro https://www.linkedin.com/in/michail-karamanos
390+
=IMAGE("https://media.licdn.com/dms/image/v2/C4E03AQH0D4fEz1b4Nw/profile-displayphoto-shrink_100_100/profile-displayphoto-shrink_100_100/0/1605259221389?e=1741824000&v=beta&t=rA8nLIM-lFOXGO1Yf0tKgCuDje5EhigFvbMxtyKmqoo") Ricardo Gabiola Santamaria Senior Finance Manager Berlin https://www.linkedin.com/in/ricardo-gabiola-santamaria-1335094a
391+
=IMAGE("https://media.licdn.com/dms/image/v2/D4D03AQEWiiAAqIfsGg/profile-displayphoto-shrink_100_100/profile-displayphoto-shrink_100_100/0/1699112682785?e=1741824000&v=beta&t=uQKWuffKCXgAzcMQcViSLgqogI6kK3TYHojWKi50QrI") Victor Botamedi Senior Software Engineer | Tech Lead | Flutter Porto https://www.linkedin.com/in/victor-botamedi
392+
=IMAGE("https://media.licdn.com/dms/image/v2/C4E03AQGd7fTteAFuWQ/profile-displayphoto-shrink_100_100/profile-displayphoto-shrink_100_100/0/1516274284771?e=1741824000&v=beta&t=76nZtAF-ZJPPb7uOYF-kT8LgyfXRpmrMnmOKQW00-0w") Rui Maranhao Abreu Research Software Engineer @ Meta & Professor of Software Engineering @ U.Porto San Francisco Bay Area https://www.linkedin.com/in/ruimaranhao"
393393
`;
394394

395395
exports[`RowsX - scrappers tests Scrapping - netflix 1`] = `

e2e/linkedin-search-people/index.html

Lines changed: 1 addition & 1 deletion
Large diffs are not rendered by default.
Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,23 @@
1+
url: https://www.linkedin.com/mynetwork/invite-connect/connections/
2+
header: Linkedin search results
3+
listElementsQuery: '[data-chameleon-result-urn*="urn:li:member:"], .mn-connection-card'
4+
elementParser:
5+
- title: Avatar
6+
query: img
7+
type: image
8+
9+
- title: Name
10+
query: '.entity-result__title-text > .app-aware-link span[aria-hidden="true"], .mn-connection-card__name'
11+
type: text
12+
13+
- title: Job
14+
query: .entity-result__primary-subtitle, .mn-connection-card__occupation
15+
type: text
16+
17+
- title: Location
18+
query: .entity-result__secondary-subtitle
19+
type: text
20+
21+
- title: Profile url
22+
query: .entity-result__title-text > .app-aware-link, .mn-connection-card__link
23+
type: clean-url

src/scrappers/linkedin.yml

Lines changed: 7 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -1,25 +1,23 @@
1-
url:
2-
- https://www.linkedin.com/search/results/*
3-
- https://www.linkedin.com/mynetwork/invite-connect/connections/
1+
url: https://www.linkedin.com/search/results/*
42
header: Linkedin search results
5-
listElementsQuery: '[data-chameleon-result-urn*="urn:li:member:"], .mn-connection-card'
3+
listElementsQuery: 'ul[role="list"] > li > div > div > div'
64
elementParser:
75
- title: Avatar
8-
query: img
6+
query: 'div > img'
97
type: image
108

119
- title: Name
12-
query: '.entity-result__title-text > .app-aware-link span[aria-hidden="true"], .mn-connection-card__name'
10+
query: 'div:nth-child(2) > div > div > div > span > span > a > span > span'
1311
type: text
1412

1513
- title: Job
16-
query: .entity-result__primary-subtitle, .mn-connection-card__occupation
14+
query: 'div:nth-child(2) > div > div:nth-child(2)'
1715
type: text
1816

1917
- title: Location
20-
query: .entity-result__secondary-subtitle
18+
query: 'div:nth-child(2) > div > div:nth-child(3)'
2119
type: text
2220

2321
- title: Profile url
24-
query: .entity-result__title-text > .app-aware-link, .mn-connection-card__link
22+
query: 'div > a'
2523
type: clean-url

0 commit comments

Comments
 (0)