lesson1Title

lesson2Title

lesson3Title

lesson4Title

lesson5Title

lesson6Title

lesson7Title

lesson8Title

lesson9Title

lesson10Title

lesson11Title

lesson12Title

lesson13Title

lesson14Title

lesson15Title

lesson16Title

lesson17Title

lesson18Title

automationIntroBasicsChapter3Title

automationIntroBasicsChapter1Title

automationIntroBasicsChapter2Title

automationIntroBasicsChapter4Title

<html>
  <body>
    <div>
      <h1>Webpage Main Title</h1>

      <h2>Webpage Subtitle</h2>

      <h3>Webpage Subsubtitle</h3>

      <p>A paragraph containing some general text</p>

      <a href="https://www.codefriends.net/" target="_blank">Go to CodeFriends</a>
    </div>
  </body>
</html>

# Essential HTML Knowledge for Web Crawling

To perform web crawling, you must first understand the structure of web pages.

One of the most crucial concepts in crawling is `HTML`.

Let's briefly explore HTML, the 'skeleton' of web pages.

> *Reference* : Check out the <a href="https://www.codefriends.net/packages/web-intro-basic" target="_blank">Introduction to Web + Build Your Own Website</a> course for more detailed information about HTML.

<br />

## What is HTML?

HTML stands for `HyperText Markup Language` and is the basic language used to create web pages.

Simply put, it defines the **structure and content** of a web page.

Web browsers interpret this HTML to display the web page on the screen.

<br />

## Essential HTML Knowledge for Web Crawling

When crawling the web, the most important thing is to accurately locate the data you want.

Let's look at the key elements of HTML that you need to know.

<br />

### 1. Tags: Building Blocks of Web Pages

HTML consists of **tags**. Tags are written in the format `<tag-name>`, defining each element of a web page.

For example, a headline is expressed with an `<h1>` tag and a paragraph with a `<p>` tag.

There are many types of tags, each with its own meaning and function.

```html title="Basic HTML Tag Example"
<h1>This is a headline</h1>
<p>This is a paragraph.</p>
```

As shown in the code above, HTML content displayed on the screen starts with an `<opening-tag>` and ends with a `</closing-tag>`.

The content of the tag is enclosed between the `<opening-tag>` and `</closing-tag>`.

This smallest unit of HTML, surrounded by the opening and closing tags, is called an `Element`.

In crawling, it is essential to identify which element contains the information you want.

<br />

### 2. Attributes: Defining the Nature of Tags

Tags can have **attributes**. Attributes define the nature of the tag or provide additional information.

For example, the `<a>` tag used to create links has an `href` attribute to specify the destination of the link and a `target` attribute to specify whether to open it in a new window.

```html title="Attribute Example"
<a href="https://www.codefriends.net/" target="_blank">
```

The HTML code above specifies that the `CodeFriends` link opens in a `new window`.

In web crawling, attributes are frequently used to locate specific elements based on their values.

Especially, `class` (used to apply the same style) and `id` (unique identifier) attributes are frequently used in web crawling.

<br />

### 3. DOM Structure: The Map of a Web Page

Web pages have a **DOM** (Document Object Model) structure where HTML tags are nested hierarchically.

Typically, a web page has elements nested within the `<html>` tag, such as `<body>`, and within the `<body>` tag, there may be `<div>` elements, and so on.

Understanding the DOM structure helps you easily identify where specific elements are located on the page.

```html title="DOM Structure Example"
<html>
  <body>
    <div>
      <p>Paragraph content</p>
    </div>
  </body>
</html>
```

When performing crawling, understanding this DOM hierarchy helps accurately extract the needed data.

HTML stands for HyperText Markup Language, which defines the structure and content of a web page. Web browsers interpret this HTML to display the web page that we see on the screen.

### HTML is used to define the structure and content of a web page.

Essential HTML Knowledge for Web Crawling