User-agent: *
Disallow: /*ref=
Disallow: /?ref=
Disallow: /?id=
Disallow: HTTrack
Disallow: Teleport
Disallow: TeleportPro
Disallow: Offline Explorer