ªð¦^¦Cªí ¤W¤@¥DÃD µo©«

[­ì³Ð] python¤W¥«Âd¤T¤jªk¤H¶R½æ¶W¤é³ø¸ê®Æ¤U¸ü

¦^´_ 150# koshi0413
½Ð°Ý¡G
¥¼©R¦W.png
2016-9-18 21:02

TOP

¦^´_ 151# c_c_lai

³o¬OÀH¾÷±Æ¦C¡A¨Ã¤£¬O¨C¶µ±Æ¦C¡A©Ò¥H¥i¯à¬O¨S½ü¨ì§a¡H
´Nºâ¯uªº¨S¦³¤]µL©Ò¿×¡A¥h¦h¦¬¶°´X­Ó´N¦n¤F~~

TOP

¦^´_ 152# koshi0413
­ì¥»¬O§Ö±N¤§«e¾Ç²ßªº Python §Ñ°O¤F¡A¦hÁ«³o½g¤å³¹Åý§Ú­«¬B¹ï¥¦ªº¿³½ì¡A
¦³¤F¤@­Ó¿ô¥Ø¹ê¥Îªº¥DÃD¡AÅý¤j®a¨Ó¤@¦P±´°Q¡A¯uªº¦³§U©ó§l¤Þ¤j®aªº¾Ç²ß¤ß¡C
§Æ±æ¤j¤j­Ì¯àµL¨p¦a±N¨ä¤ß±o¤À¨É¡A¦³¤F¹ê»Ú±o¥HÀ³¥Îªº¹ê¥Î½d¨Ò¡A¯u¹ê¦a
IJµo¨Dª¾¼¤ªº±o¥Hº¡¨¬¡A³o¥ç¬O§Ú­Ó¤Hªº²z·Q¡C
ÁÂÁÂÅo¡I

TOP

¥»©«³Ì«á¥Ñ koshi0413 ©ó 2016-9-20 14:21 ½s¿è

¤U­±¬O§ä¨ìªº¤å³¹¡A¥Î pythonªº¥i¥H¬Ý¤@¤U¡G
¤p§Ìªþ¤Wªº¥N½X¬O¬°¤FÀ³¥I³oÃþªº¡A¨ä¥¦ªº´N°Ñ¦Ò¤F¡A¬Ý¬ÝÁ`¨SÃa³B

http     +      s://zhuanlan.zhihu.com/p/20520370

0x02 ³q过Headers¤Ïª¦¦ä
从¥Î户请¨DªºHeaders¤Ïª¦¦ä¬O³Ì±`见ªº¤Ïª¦¦äµ¦²¤¡C«Ü¦hÊI¯¸³£会对HeadersªºUser-Agent进¦æ检测¡A
还¦³¤@³¡¤ÀÊI¯¸会对Referer进¦æ检测¡]¤@¨Ç资·½ÊI¯¸ªº¨¾盗链´N¬O检测Referer¡^¡C
¦pªG¹J¨ì¤F这类¤Ïª¦¦äÉó¨î¡A¥i¥Hª½±µ¦bª¦¦ä¤¤²K¥[Headers¡A将浏览¾¹ªºUser-AgentÎ`¨î¨ìª¦¦äªºHeaders¤¤¡F
©ÎªÌ将Referer­È­×§ï为¥Ø标ÊI¯¸°ì¦W¡C对¤_检测Headersªº¤Ïª¦¦ä¡A¦bª¦¦ä¤¤­×§ï©ÎªÌ²K¥[Headers´N¯à«Ü¦nªº绕过¡C

¥Ø«e·Q°w¹ï³oºØªº¤U¤â¡G
0x03 °ò¤_¥Î户¦æ为¤Ïª¦¦ä
还¦³¤@³¡¤ÀÊI¯¸¬O³q过检测¥Î户¦æ为¡A¨Ò¦p¦P¤@IPµu时间内¦h¦¸访问¦P¤@页­±¡A©ÎªÌ¦P¤@账户µu时间内¦h¦¸进¦æ¬Û¦P¾Þ§@¡C

²{¦b¥d¦b³oºØ@@
0x04 动态页­±ªº¤Ïª¦¦ä

TOP

¦^´_ 154# koshi0413
¤£¿ùªº¤å³¹¡AÁÂÁ¤À¨É¡C
¤j¶qª¦¨úªº®É­Ô¥[¶i¤@¨Çsleep«Ü¦n¡AÁקKµu®É¶¡¤j¶qrequest³y¦¨ºô¯¸¹L¤jªº­t¾á¡C
selenium+phantomJSªº²Õ¦X¥i¥HÁô§ÎÂsÄý¾¹¡A¤£¹L¦pªG¤£¤¶·N¡A¥Îfirefox©Îchrome¤]¥i¥H¡C

TOP

¥»©«³Ì«á¥Ñ koshi0413 ©ó 2016-9-21 10:09 ½s¿è
¦^´_  koshi0413
¤£¿ùªº¤å³¹¡AÁÂÁ¤À¨É¡C
¤j¶qª¦¨úªº®É­Ô¥[¶i¤@¨Çsleep«Ü¦n¡AÁקKµu®É¶¡¤j¶qrequest³y¦¨ ...
zyzzyva µoªí©ó 2016-9-21 09:34


°ÊºAajaxºô­¶  ¥Ø«e¬O¥Î selenium+chrome¸Ñ¨M
¥u¬O³æ¯Â·Q¥Î requests¡ABeautifulSoup ¥æ¤¬ÅTÀ³ ªº¤è¦¡¨Ó¸Ñ
¥Ø«e¸Ñ¤£±¼@@
¬ÛÃöª¾ÃÑÁÙ¤£°÷¡A¤Ö¤@­Óheaders°Ñ¼Æ ³£¬OÅܤƦ¡¶Ã½X¡AÁÙ¦b«ä¦Ò¤¤

ps:¦³¬d¤F¤@¤U¡A¦n¹³­n¥Î cookie µM«á¦b§ì¨ú ¥t¥~¤G°Ñ¼Æªº¶Ã¼Æ½X¡]¥Ø«e§ì¨ì¤@­Ó¡A¥tÁÙ¤@Á٧䤣¨ì³W«ß¡^
¤£¹L¤p§Ì¦Û¤v¤]¤£½T©w°Õ
requests.session() ¦n¦h¦¸ÁÙ¬O¨S¤ÏÀ³¡A«¢«¢

TOP

¦^´_ 155# zyzzyva
½Ð±Ð¤j¤j
¬°¦ó³Ìªñ§Úªº Anaconda 3.5 ¤£Â_·|¥X²{
"The kernel has died, and the automatic restart has failed"
ÁÂÁ¡I

TOP

¦^´_ 157# c_c_lai
±z¬O°õ¦æ¤°»ò¯S©w«ü¥Oªº®É­Ô·|·í±¼ÁÙ¬O¤@¶}´N·í±¼¡H
¦³§ó·s©Î¦w¸Ë·sªºÀô¹Ò©Î®M¥ó¶Ü¡H¦³¨S¦³¨ä¥Lªº¿ù»~°T®§¡H

TOP

¦^´_ 158# zyzzyva
¶i¤J Anaconda Navigator «á¡A¿ï®× Jupyter Notebook
¥u­n¶i¤J·s®×©Î®סA¥k¤W¨¤ÀH§Y¥X²{¦¹°T®§¡A³Ì«á¥¦·|
Åã¥Ü "No Kernel"¡C
§Ú¤Wºô¬dµ²ªG¤@¤j¥d¨®ªº¬Û¦P´£°Ý¡C
§Ú²{¦b¤@¤@ªº©¹«e¦w¸Ë³v¤@ª©¥»¦A¸Õ¸Õ¡A
¤w½T©w Anaconda3-4.1.1-Windows (§t) ¥H¤W§¡¤£¦æ¡C

TOP

¦^´_ 159# c_c_lai
¦bcmd©³¤U°õ¦æjupyter kernelspec list¦³¦^À³¶Ü¡H

TOP

        ÀR«ä¦Û¦b : ¥¬¬I¦p¼½ºØ¡A¥HÅw³ß¤ß´þ¼íºØ¤l¡A¤~·|µoªÞ¡C
ªð¦^¦Cªí ¤W¤@¥DÃD