{"id":233250,"date":"2023-02-09T16:00:00","date_gmt":"2023-02-09T13:00:00","guid":{"rendered":"https:\/\/wordpress.mediadoma.com\/?p=233250"},"modified":"2022-11-10T20:07:08","modified_gmt":"2022-11-10T17:07:08","slug":"studium-przypadku-uzyj-phpquery-do-przeszukania-3000-obrazow-z-tumblr","status":"publish","type":"post","link":"https:\/\/wordpress.mediadoma.com\/pl\/studium-przypadku-uzyj-phpquery-do-przeszukania-3000-obrazow-z-tumblr\/","title":{"rendered":"Studium przypadku: u\u017cyj PHPQuery do przeszukania 3000 obraz\u00f3w z Tumblr"},"content":{"rendered":"

Na Tumblrze jest kilka fajnych obrazk\u00f3w. Mo\u017cemy u\u017cywa\u0107 interfejs\u00f3w API Tumblr do wyszukiwania i pobierania obraz\u00f3w, jednak zwykle wymaga to rejestracji i kluczy API. Innym sposobem jest indeksowanie stron internetowych HTML i parsowanie DOM (Document Object Model)<\/a>, kt\u00f3ry pozwala nam pobra\u0107 adresy URL obraz\u00f3w i ich opisy.<\/p>\n

Istnieje przydatna biblioteka o nazwie PHPQuery. Pozwala nam pisa\u0107 PHP<\/a> w stylu JQuery w taki sam spos\u00f3b, w jaki piszemy JQuery<\/a>, przy u\u017cyciu selektor\u00f3w CSS. To sprawia, \u017ce \u200b\u200bPHP jest pot\u0119\u017cnym narz\u0119dziem do analizy DOM dowolnych stron HTML.<\/p>\n

phpquery<\/p>\n

Poni\u017cej znajduje si\u0119 pseudokod, kt\u00f3ry ilustruje, jak analizowa\u0107 strony HTML<\/a> i pobiera\u0107 obrazy.<\/p>\n

Dzi\u0119ki PHPQuery analiza DOM staje si\u0119 o wiele \u0142atwiejsza!<\/a> Kliknij, aby tweetowa\u0107<\/a><\/p>\n

require('phpQuery.php');\nrequire('app.php');\n\u00a0\n$ip = get_ip_address();\n\u00a0\nfunction grab($url, $lvl = 5) {\n\u00a0 global $ip;\n\u00a0 if ($lvl < = 0) {\n\u00a0 \u00a0 return;\n\u00a0 }\n\u00a0 $doc = phpQuery::newDocumentFile($url);\n\u00a0 foreach(pq('div.TumbPostPane') as $p) {\n\u00a0 \u00a0 \u00a0 $img = pq($p)->find('img.PhotoPostMainPhoto')->attr('src');\n\u00a0 \u00a0 \u00a0 $desc = htmlspecialchars(trim(pq($p)->find('div.MetaPanel')->html()));\n\u00a0 \u00a0 \u00a0 $url = pq($p)->find('a')->attr('href');\n\u00a0 \u00a0 \u00a0 $err = '';\n\u00a0 \u00a0 \u00a0 if (UploadPic($img, $desc, $err, $ip)) { \/\/ find pictures and save locally\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0echo \"OK = $err n\";\n\u00a0 \u00a0 \u00a0 } else {\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0echo str_replace(\"<br \/>\", \"n\", \"Error = $err n\");\n\u00a0 \u00a0 \u00a0 } \u00a0 \u00a0 \n\u00a0 \u00a0 \u00a0 grab($url, $lvl - 1); \/\/ recursive download\n\u00a0 }\n}\n\u00a0\ngrab(\"<a class=\"vglnk\" target=\"_blank\" href=\"https:\/\/uploadbeta.com\" rel=\"nofollow\"><span>https<\/span><span>:\/\/<\/span><span>uploadbeta<\/span><span>.<\/span><span>com<\/span><\/a>\", 1); <\/code><\/pre>\n
Przy niewielkich modyfikacjach mo\u017cesz pozwoli\u0107 skryptowi przeszukiwa\u0107 kilka tysi\u0119cy zdj\u0119\u0107 w ci\u0105gu kilku minut. Wszystkie obrazy s\u0105 zapisywane w lokalnych bazach danych na serwerze VPS<\/a>. Zdj\u0119cia mo\u017cna zobaczy\u0107 na: uploadbeta.com<\/a><\/p>\n
Lepiej ustawi\u0107 odst\u0119p czasu mi\u0119dzy indeksowaniem strony, w przeciwnym razie adres IP<\/a> mo\u017ce zosta\u0107 zablokowany.<\/p>\n
\"Studium<\/a><\/p>\n
Indeksowanie obrazu<\/p>\n
PS, witryna Image Upload obs\u0142uguje kilka interfejs\u00f3w API do r\u00f3\u017cnych cel\u00f3w podlegaj\u0105cych polityce dozwolonego u\u017cytku: https:\/\/uploadbeta.com\/picture-gallery\/faq.php#api<\/a><\/p>\n
\u0179r\u00f3d\u0142o nagrywania:  helloacm.com<\/a><\/div><\/p>\n","protected":false},"excerpt":{"rendered":"
Studium przypadku: u\u017cyj PHPQuery do przeszukania 3000 obraz\u00f3w z Tumblr<\/p>\n","protected":false},"author":1,"featured_media":220869,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_wp_rev_ctl_limit":""},"categories":[897,919,897,919,1110,1020,805,805,1020,845,845],"tags":[1169],"class_list":{"0":"post-233250","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","6":"hentry","7":"category-kod","8":"category-inny","11":"category-n-a","12":"category-przydatne-strony","13":"category-php-7","16":"category-samouczki","18":"tag-affiai-pl"},"_links":{"self":[{"href":"https:\/\/wordpress.mediadoma.com\/pl\/wp-json\/wp\/v2\/posts\/233250","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wordpress.mediadoma.com\/pl\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wordpress.mediadoma.com\/pl\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wordpress.mediadoma.com\/pl\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/wordpress.mediadoma.com\/pl\/wp-json\/wp\/v2\/comments?post=233250"}],"version-history":[{"count":0,"href":"https:\/\/wordpress.mediadoma.com\/pl\/wp-json\/wp\/v2\/posts\/233250\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/wordpress.mediadoma.com\/pl\/wp-json\/wp\/v2\/media\/220869"}],"wp:attachment":[{"href":"https:\/\/wordpress.mediadoma.com\/pl\/wp-json\/wp\/v2\/media?parent=233250"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wordpress.mediadoma.com\/pl\/wp-json\/wp\/v2\/categories?post=233250"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wordpress.mediadoma.com\/pl\/wp-json\/wp\/v2\/tags?post=233250"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}