ʻO kahi pūnaewele robots.txt e mālamaʻia ma ke kumu o kāu pūnaewele e haʻi i nā pūnaewele pūnaewele e like me nā spiders search engine pehea nā papa kuhikuhi a me nā faile eʻaeʻia e holo. He mea maʻalahi ke hoʻohanaʻana i kahi pūnaewele robots.txt, akā aia kekahi mau mea e hoʻomanaʻo aiʻoe:
- Na ka pūnaewele hōʻailona pōkole e nānā i kāu pūnaewele robots.txt. ʻO nāʻano maʻamau ka pūnaewele polokalamu a me nā robots e nānā nei i nā leka uila i kaʻohiʻaiʻana.
- ʻO kekahi mau polokalamu polokalamu hou e kākau i nā robots e mālamaʻole i ka pūnaewele robots.txt. Hanaʻia kēia ma ke kuhihewa.
- Hiki keʻike i kāu kōnae robots.txt. Hoʻokomo mauʻia lākou he robots.txt a ua mālama mauʻia ma ke kumu o ka pūnaewele.
- I ka hopena, inā pili kekahi i kahi faila a papa kuhikuhi paha i kāpaeʻia e kāu pūnaewele robots.txt mai kahiʻaoʻao i weheʻoleʻia e kā lākou robots.txt file, e loaʻa paha i nā engines hulina.
Mai hoʻohana i nā pūnaewele robots.txt e hūnā i kekahi mea nui. Ma kahi kūpono, ponoʻoe e waiho i kaʻike nui ma hope o nā'ōlelo hua'ōlelo palekana a waihoʻia paha ma waho o ka pūnaewele.
Pehea e hoʻohana ai i kēia mau polokalamu kiʻi
E kāpili i ka kikokikona mai ka'ōpana kokoke loa i ka mea āu e makemake ai, a pasi i loko o kāu pūnaewele robots.txt. E hoʻololi i ka robot, ka papa kuhikuhi, a me nā inoa e hoʻohālike i kāu hoʻonohonoho kūpono.
ʻElua Pūnaewele Robots.txt
Mea hoʻohana pūnaewele: *
Kōpae: /
Ke'ōlelo nei kēia'iliake i kēlā me kēia'ūkini (ʻOhana-hoʻohana: *) i loaʻa iā ia e ponoʻole ke haʻalele i nāʻaoʻao a pau ma ka pūnaewele (Disallow: /).
Mea hoʻohana pūnaewele: *
Kōpae:
Hōʻike kēia waihona i kēlā me kēia manunu (ʻOhana-lawelawe: *) e hiki keʻaeʻia eʻaeʻia e nānā i kēlā me kēiaʻaoʻao ma ka pūnaewele (Disallow:).
Hiki iāʻoe ke hana i kēia ma ka waihoʻana i kāu blanks.txt file blank a iʻoleʻaʻohe hoʻokahi ma kāu pūnaewele.
Hoʻomalu i nā Kūlana Kūikawā Mai Robots
Mea hoʻohana pūnaewele: *
ʻO Disallow: / cgi-bin /
Hoʻolaha: / temp /
Ke'ōlelo nei kēia'iliake i kēlā me kēia mea hanaʻole (ʻOhana-hoʻohana: *) i loaʻa iā ia e haʻalele i nā waihona / cgi-bin / a / temp / (Disallow: / cgi-bin / Disallow: / temp /).
Hoʻopili i nā Palapala Kūikawā Mai Robots
Mea hoʻohana pūnaewele: *
ʻO Disallow: /jenns-stuff.htm
Kōpaeʻole: /private.php
Ke'ōlelo nei kēia'iliake i kēlā me kēia kekomi (ʻOhana-lawelawe: *) i loaʻa iā ia e ponoʻole e haʻalele i nā faila /jenns-stuff.htm a /private.php (Disallow: /jenns-stuff.htm Disallow: /private.php).
E hana i kahi papa hana kūikawā mai kaʻikeʻana i kāu pūnaewele
Luna hoʻohana: Lycos / xx
Kōpae: /
Ke'ōlelo nei kēia palapala i kaʻole Lycos bot (Luna hoʻohana: Lycos / xx)ʻaʻole eʻaeʻia i kahi ma kahi o ka pūnaewele (Disallow: /).
Eʻae i kahi kahi hana hoʻokahi wale nō ke koho
Mea hoʻohana pūnaewele: *
Kōpae: /
Mea hoʻohana o Google: Googlebot
Kōpae:
Hoʻopau mua kēia kōnae i nā robots e like me kā mākou i hana ai ma luna, a laila e hōʻike pololeiʻia i ka Googlebot (Luna hoʻohana: Googlebot) ke komo i nā mea a pau (Disallow:).
E hoʻohui i nā Lulu Nui e Loaʻa i nā Exclusions Kana e makemake ai
ʻOiai eʻoi aku ka maikaʻi o ka hoʻohanaʻana i kahi laina lawelawe o ka mea hoʻohana nui, e like me ka mea hoʻohana pūnaewele: *, hiki iāʻoe ke hoʻohālikelike e like me kou makemake. E hoʻomanaʻo i nā robots e heluhelu pono i ka faila. No laila, inā'ōlelo nā laina mua, ua kāpaeʻia nā robots mai nā mea a pau, a ma hope aku ma loko o ka waihona e'ōlelo ana ua hiki i nā robots ke komo i nā mea a pau, hiki i nā robots ke komo i nā mea a pau.
Ināʻaʻoleʻoe i maopopo inā ua pololei kāu kākauʻana i kāu pūnaewele robots.txt, hiki iāʻoe ke hoʻohana i nā mea hoʻohana pūnaewele o Google e nānā i kāu pūnaewele robots.txt a iʻoleʻoe e kākau i kahi mea hou.