The most popular package that implements XPath selectors in Python is lxml. We can use the xpath() method to find all matching values:
python
from lxml import etree
tree = etree.fromstring("""
<div>
<a>link 1</a>
<a>link 2</a>
</div>
""")
for result in tree.xpath("//a"):
print(result.text)
"link 1"
"link 2"However, in web scraping the recommended way is to use the parsel package. It's based on lxml and providers a more consistent behavior when working with HTML content:
python
from parsel import Selector
selector = Selector("""
<div>
<a>link 1</a>
<a>link 2</a>
</div>
""")
selector.xpath("//a").getall()
['<a>link 1</a>', '<a>link 2</a>']
