ÉèΪÊ×Ò³ ¼ÓÈëÊÕ²Ø

TOP

hadoop fs   ³£ÓõÄshellÃüÁîÐÐ
2018-12-13 08:27:12 ¡¾´ó ÖРС¡¿ ä¯ÀÀ:31´Î
Tags£ºhadoop   ³£Óà shell ÃüÁî


Ô­²©¿ÍµØÖ·£ºhttp://blog.csdn.net/wuwenxiang91322/article/details/22166423


1£¬Hadoopfs ¨Cfs [local | <file system URI>]£ºÉùÃ÷hadoopʹÓõÄÎļþϵͳ£¬Èç¹û²»ÉùÃ÷µÄ»°£¬Ê¹Óõ±Ç°ÅäÖÃÎļþÅäÖõģ¬°´ÈçÏÂ˳Ðò²éÕÒ£ºhadoop jarÀïµÄhadoop-default.xml->$HADOOP_CONF_DIRϵÄhadoop-default.xml->$HADOOP_CONF_DIRϵÄhadoop-site.xml¡£Ê¹ÓÃlocal´ú±í½«±¾µØÎļþϵͳ×÷ΪhadoopµÄDFS¡£Èç¹û´«µÝuri×ö²ÎÊý£¬ÄÇô¾ÍÊÇÌض¨µÄÎļþϵͳ×÷ΪDFS¡£

2£¬hadoop fs ¨Cls <path>£ºµÈͬÓÚ±¾µØϵͳµÄls£¬ÁгöÔÚÖ¸¶¨Ä¿Â¼ÏµÄÎļþÄÚÈÝ£¬Ö§³ÖpatternÆ¥Åä¡£Êä³ö¸ñʽÈçfilename(full path) <r n> size.ÆäÖÐn´ú±íreplicaµÄ¸öÊý£¬size´ú±í´óС£¨µ¥Î»bytes£©¡£

3£¬hadoop fs ¨Clsr <path>£ºµÝ¹éÁгöÆ¥ÅäpatternµÄÎļþÐÅÏ¢£¬ÀàËÆls£¬Ö»²»¹ýµÝ¹éÁгöËùÓÐ×ÓĿ¼ÐÅÏ¢¡£

4£¬hadoop fs ¨Cdu <path>£ºÁгöÆ¥ÅäpatternµÄÖ¸¶¨µÄÎļþϵͳ¿Õ¼ä×ÜÁ¿£¨µ¥Î»bytes£©£¬µÈ¼ÛÓÚunixϵÄÕë¶ÔĿ¼µÄdu ¨Csb <path>/*ºÍÕë¶ÔÎļþµÄdu ¨Cb <path> £¬Êä³ö¸ñʽÈçname(full path) size(in bytes)¡£

5£¬hadoop fs ¨Cdus <path>£ºµÈ¼ÛÓÚ-du£¬Êä³ö¸ñʽҲÏàͬ£¬Ö»²»¹ýµÈ¼ÛÓÚunixµÄdu -sb¡£

6£¬hadoop fs ¨Cmv <src> <dst>£º½«Öƶ¨¸ñʽµÄÎļþ moveµ½Ö¸¶¨µÄÄ¿±êλÖᣵ±srcΪ¶à¸öÎļþʱ£¬dst±ØÐëÊǸöĿ¼¡£

7£¬hadoop fs ¨Ccp <src> <dst>£º¿½±´Îļþµ½Ä¿±êλÖ㬵±srcΪ¶à¸öÎļþʱ£¬dst±ØÐëÊǸöĿ¼¡£

8£¬hadoop fs ¨Crm [-skipTrash] <src>£ºÉ¾³ýÆ¥ÅäpatternµÄÖ¸¶¨Îļþ£¬µÈ¼ÛÓÚunixϵÄrm <src>¡£

9£¬hadoop fs ¨Crmr [skipTrash] <src>£ºµÝ¹éɾµôËùÓеÄÎļþºÍĿ¼£¬µÈ¼ÛÓÚunixϵÄrm ¨Crf <src>¡£

10£¬hadoop fs ¨Crmi [skipTrash] <src>£ºµÈ¼ÛÓÚunixµÄrm ¨Crfi <src>¡£

11£¬hadoop fs ¨Cput <localsrc> ¡­ <dst>£º´Ó±¾µØϵͳ¿½±´Îļþµ½DFS¡£

12£¬hadoop fs ¨CcopyFromLocal <localsrc> ¡­ <dst>£ºµÈ¼ÛÓÚ-put¡£

13£¬hadoop fs ¨CmoveFromLocal <localsrc> ¡­ <dst>£ºµÈͬÓÚ-put£¬Ö»²»¹ýÔ´ÎļþÔÚ¿½±´ºó±»É¾³ý¡£

14£¬hadoop fs ¨Cget [-ignoreCrc] [-crc] <src> <localdst>£º´ÓDFS¿½±´Îļþµ½±¾µØÎļþϵͳ£¬ÎļþÆ¥Åäpattern£¬ÈôÊǶà¸öÎļþ£¬Ôòdst±ØÐëÊÇĿ¼¡£

15£¬hadoop fs ¨Cgetmerge <src> <localdst>£º¹ËÃû˼Ò壬´ÓDFS¿½±´¶à¸öÎļþ¡¢ºÏ²¢ÅÅÐòΪһ¸öÎļþµ½±¾µØÎļþϵͳ¡£

16£¬hadoop fs ¨Ccat <src>£ºÕ¹Ê¾ÎļþÄÚÈÝ¡£

17£¬hadoop fs ¨CcopyToLocal [-ignoreCrc] [-crc] <src> <localdst>£ºµÈ¼ÛÓÚ-get¡£

18£¬hadoop fs ¨Cmkdir <path>£ºÔÚÖ¸¶¨Î»Öô´½¨Ä¿Â¼¡£

19£¬hadoop fs ¨Csetrep [-R] [-w] <rep> <path/file>£ºÉèÖÃÎļþµÄ±¸·Ý¼¶±ð£¬-R±êÖ¾¿ØÖÆÊÇ·ñµÝ¹éÉèÖÃ×ÓĿ¼¼°Îļþ¡£

20£¬hadoop fs ¨Cchmod [-R] <MODE[,MODE]¡­|OCTALMODE> PATH¡­£ºÐÞ¸ÄÎļþµÄȨÏÞ£¬-R±ê¼ÇµÝ¹éÐ޸ġ£MODEΪa+r,g-w,+rwxµÈ£¬OCTALMODEΪ755ÕâÑù¡£

21£¬hadoop fs -chown [-R] [OWNER][:[GROUP]] PATH¡­£ºÐÞ¸ÄÎļþµÄËùÓÐÕߺÍ×é¡£-R±íʾµÝ¹é¡£

22£¬hadoop fs -chgrp [-R] GROUP PATH¡­£ºµÈ¼ÛÓÚ-chown ¡­ :GROUP ¡­¡£

23£¬hadoop fs ¨Ccount[-q] <path>£º¼ÆÊýÎļþ¸öÊý¼°ËùÕ¼¿Õ¼äµÄÏêÇ飬Êä³ö±í¸ñµÄÁеĺ¬ÒåÒÀ´ÎΪ£ºDIR_COUNT,FILE_COUNT,CONTENT_SIZE,FILE_NAME»òÕßÈç¹û¼ÓÁË-qµÄ»°£¬»¹»áÁгöQUOTA,REMAINING_QUOTA,SPACE_QUOTA,REMAINING_SPACE_QUOTA¡£



¡¾´ó ÖРС¡¿¡¾´òÓ¡¡¿ ¡¾·±Ìå¡¿¡¾Í¶¸å¡¿¡¾Êղء¿ ¡¾ÍƼö¡¿¡¾¾Ù±¨¡¿¡¾ÆÀÂÛ¡¿ ¡¾¹Ø±Õ¡¿ ¡¾·µ»Ø¶¥²¿¡¿
ÉÏһƪ£º½áºÏ°¸Àý½²½âMapReduceÖØҪ֪ʶµã.. ÏÂһƪ£ºHadoop 2.7.2   linux·Ö²¼..

×îÐÂÎÄÕÂ

ÈÈÃÅÎÄÕÂ

Hot ÎÄÕÂ

Python

C ÓïÑÔ

C++»ù´¡

´óÊý¾Ý»ù´¡

linux±à³Ì»ù´¡

C/C++ÃæÊÔÌâÄ¿