Commit 2367127f authored by Alexander Ross Melnick's avatar Alexander Ross Melnick
Browse files

initial inquiry into cross-language dictionaries

parent 30a75a63

Crawler/src/main/java/ScratchCrawler.class

+145 B (10.7 KiB)

File changed.

No diff preview for this file type.

View original file
View changed file

Crawler/src/main/java/ScratchCrawler.java

+5 −0
Original line number Diff line number Diff line
@@ -415,6 +415,11 @@ public class ScratchCrawler { 
                    crawler.pagesToVisit.add("https://www.tumblr.com/");

                    startCrawl = true;

                    break;

                case "--dutch":

                    // Extension of our crawler with an English to Dutch translation

                    crawler.pagesToVisit.add("https://travelwithlanguages.com/blog/most-common-dutch-words.html");

                    startCrawl = true;

                    break;

                case "--help":

                    System.out.println("Usage: java ScratchCrawler [--file <file_path>] or [--seed <seed_url>] or [--help]");

                    System.out.println("--file <file_path>: Read URLs from a file and start crawling");

Crawler/src/main/java/crawledData.txt

+7.09 KiB (42.9 KiB)

File changed.

No diff preview for this file type.

View original file
View changed file