User-agent: TurnitinBot Disallow: / User-agent: Twiceler Disallow: / User-agent: BecomeBot Disallow: / User-agent: Slurp Disallow: /indie-music/ User-agent: MSIE Crawler Disallow: / User-agent: SBIder Disallow: / User-agent: Yandex Disallow: / User-Agent: * Disallow: /cgi-bin/ Disallow: /bin/ Disallow: /_vti_cnf/ Disallow: /_vti_log/ Disallow: /_vti_pvt/ Disallow: /_vti_script/ Disallow: /_vti_txt/ Disallow: /_private/ Disallow: /_borders/ Disallow: /_sharedtemplates/ Disallow: /_dropdowns/ Disallow: /_fpclass/ Disallow: /404/ Disallow: /music/albums/index.htm Disallow: /music/gigs/index.htm Disallow: /sitemap-albums/ Disallow: /sitemap-gigs/ Disallow: /sitemapdotnet/ Disallow: /discussion/post.asp Disallow: /discussion/login.asp Disallow: /discussion/faq.asp Disallow: /discussion/post_info.asp Disallow: /discussion/pop_profile.asp Disallow: /discussion/pop_printer_friendly.asp Disallow: /discussion/members.asp Disallow: /discussion/active.asp Disallow: /indie-music/Register.aspx Disallow: /indie-music/Blogs/Album_Reviews.aspx Disallow: /indie-music/Blogs/Gig_Reviews.aspx Disallow: /indie-music/Albums/tabid/53/Default.aspx Disallow: /indie-music/Gigs/tabid/55/Default.aspx Disallow: /indie-music/Documentation/StarterKit/ Disallow: /indie-music/DesktopModules/Blog/Trackback.aspx Disallow: /indie-music/Discussion/tabid/63/view/search/ Disallow: /indie-music/Discussion/tabid/63/view/activetopics/ Disallow: /indie-music/Discussion/tabid/63/forumid/1/postid/ Disallow: /indie-music/Discussion/tabid/63/forumid/4/postid/ Disallow: /indie-music/Discussion/tabid/63/forumid/5/postid/ Disallow: /indie-music/Discussion/tabid/63/forumid/7/postid/ Disallow: /indie-music/Discussion/tabid/63/view/topics/forumid/1/ Disallow: /indie-music/Discussion/tabid/63/view/topics/forumid/4/ Disallow: /indie-music/Discussion/tabid/63/view/topics/forumid/5/ Disallow: /indie-music/Discussion/tabid/63/view/topics/forumid/7/ Disallow: /indie-music/Discussion/tabid/63/view/profile/uid/ Disallow: /indie-music/Discussion/tabid/63/view/members/ Disallow: /indie-music/Blogs/Short_Cuts/tabid/79/BlogID/14/Default.aspx Disallow: /indie-music/Blogs/French_Letter/tabid/80/BlogID/5/Default.aspx Disallow: /indie-music/Blogs/Beijing_Beat/tabid/81/BlogID/15/Default.aspx Disallow: /indie-music/Blogs/Key_Notes/tabid/93/BlogID/24/Default.aspx Disallow: /indie-music/Blogs/Sound_Waves/tabid/78/BlogID/3/Default.aspx Disallow: /indie-music/Blogs/Album_Reviews/tabid/87/BlogID/18/Default.aspx Disallow: /indie-music/Blogs/Gig_Reviews/tabid/96/BlogID/25/Default.aspx Disallow: *returnurl Disallow: */modalert/ Disallow: */ctl/ Disallow: */afnav/ Disallow: */tpage/1/ Disallow: */tpage/2/Default.aspx Disallow: */tpage/3/Default.aspx Disallow: */tpage/4/Default.aspx Disallow: */tpage/5/Default.aspx Disallow: */tpage/6/Default.aspx Disallow: */tpage/7/Default.aspx Disallow: */affilter/ Disallow: */afgroup/ Disallow: */BlogDate/ Disallow: */SendEmail/ Disallow: */unanswered/ Disallow: */PostedBy/ Disallow: */afv/topic/afc/ Disallow: */afv/topic/afpgj/ Disallow: */stream