In today’s video, we explore an efficient approach to extracting data from web pages and summarizing it with the latest large language models (LLMs) using standard Python code. This method is handy in improving your SEO by generating concise meta descriptions for your web pages.

We can use API-based models, such as OpenAI’s GPT-4 or Google’s PaLM, for our text summarization. In this demonstration, we incorporate the Python SDK from Vertex AI to call Google’s PaLM-2 Chat AI.