weibo

Baiduspider应该吃点脑白金补补,整天没头没脑瞎转悠

  •  
  •   weibo · Jun 18, 2012 · 1645 views
    This topic created in 5261 days ago, the information mentioned may be changed or developed.
    该看的不看,不给看的非要看,同一个死胡同天天进去溜达一圈。
    2 replies  •  1970-01-01 08:00:00 +08:00
    sivacohan
    sivacohan
    Jun 18, 2012
    1
    你没写robots文件吗?
    weibo
    weibo
    OP
    Jun 22, 2012
    2
    就是因为写了不管用才吐槽哇。丫根本就无视robots。
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Privacy   ·   Solana   ·   961 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 27ms · UTC 19:45 · PVG 03:45 · LAX 11:45 · JFK 14:45
    ♥ Do have faith in what you're doing.