且构网

分享程序员开发的那些事...
且构网 - 分享程序员编程开发的那些事

JSoup - 通过标签解析HTML标签

更新时间:2023-12-03 20:22:28

要获得html正文中的所有文本,您可以使用:

  Document doc = Jsoup.connect(url).get(); 
Elements body = doc.select(body);
String allText = body [0] .text();

然后,您可以拆分文本以将每个单词分开。
要获取div标签中的文本,您可以使用:

 元素div = doc.select(div ); 
String divText = div [0] .text();

然后,您可以拆分divText来获取每个句子。注意,select查询的返回类型实际上是Element的列表,即元素。这是因为可以有多个匹配你的元素 select 查询。在这种情况下,由于每种情况只有一个元素,我们可以通过访问返回数组的索引0来访问它。



编辑:为了迭代所有元素请检查此答案。基本上

 元素元素= doc.body()。select(*); (元素元素){
System.out.println(element.text());



$ / code>

尽管可能有没有文字的元素,所以您可以检查一下。


I'm actually developping a text parser in Java and I was asked to enhance it by parsing HTML with it. The parser's purpose is to divide the file parsed into 3 other files, one with all the words contained in the file, one with all sentences and the other with all questions.

The *.txt part works perfectly, but I got a problem when parsing HTML.

I create a temporary file with *.txt extension and pass it in my text parser, but if I pass an URL with HTML file linked which is formed like this:

<!DOCTYPE html>
    <head>
        ... some HTML here ...
    </head>
    <body>
        <ul class="some_menu">
            <li class="some_menu_item">n1</li>
            <li class="some_menu_item">n2</li>
            <li class="some_menu_item">n2</li>
        </ul>
        <div>
            This is a question ?
            This is a sentence .
            ... some other text ...
        </div>
    </body>
</html>

the question file will be filled with: n1 n2 n3 This is a question

So, I just was wondering, is there a way to parse with JSoup tags by tags so I can add a line feed each time a block is closed?

If you need some new informations, don't bother to ask!

Edit: I should have 3 output files, which are, for this example:

  1. One with all the words

    n1
    n2
    n3
    This
    is
    a
    question
    sentence
    ... some other words ...
    

  2. One with all the sentences

    This is a sentence
    

  3. One with all the questions

    This is a question
    

TimmyM

To get all the text in an html body, you can use:

Document doc = Jsoup.connect(url).get();
Elements body = doc.select("body");
String allText = body[0].text();

You can then split the text to get each word separate. To get the text in the div tag, you can use:

Elements div = doc.select("div");
String divText = div[0].text();

You can then split the divText to get each sentence.

Notice that the return type of the select query is actually a list of Element i.e., Elements. That's because there can be more than one elements matching you select query. In this case, since there is only one element for each case we access it by accessing the index 0 of the returned array.

Edit: In order to iterate through all elements check this answer. Basically

Elements elements = doc.body().select("*");

for (Element element : elements) {
    System.out.println(element.text());
}

Though there might be elements with no texts so you can put a check on that.