{"rsdb":{"rid":"309058","subhead":"","postdate":"0","aid":"224220","fid":"114","uid":"1","topic":"1","content":"
\u95ee\u9898\u8be6\u60c5<\/span><\/strong><\/span><\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n \u95ee\u9898\u5206\u6790<\/span><\/strong><\/span><\/p>\n \u3000\u3000\u9519\u8bef\u4ea7\u751f\u539f\u56e0\uff0c\u6709\u7f51\u53cb\u8bf4\u662f\u9891\u7e41\u67e5\u8be2\u548c\u66f4\u65b0dede_archives\u8868\u9020\u6210\u7684\u7d22\u5f15\u9519\u8bef\uff0c\u56e0\u4e3a\u6211\u7684\u9875\u9762\u6ca1\u6709\u9759\u6001\u751f\u6210\uff0c\u800c\u662f\u52a8\u6001\u9875\u9762\uff0c\u56e0\u6b64\u6bd4\u8f83\u540c\u610f\u8fd9\u79cd\u8bf4\u6cd5\u3002 <\/p>\n \u3000\u3000\u6211\u8fd9\u91cc\uff0c\u662f\u5728\u8dd1azkaban\u4efb\u52a1\u7684\u65f6\u5019\uff0c\u95f4\u9694\u53d6\u7684\u592a\u5c0f\uff0c\u540c\u65f6\u81ea\u5df1\u7535\u8111\u914d\u7f6e\u4e0d\u592a\u9ad8\uff0c\u5bfc\u81f4\uff0c\u901f\u5ea6\u5f88\u6162\u548c\u5361\u987f\u3002\u6211\u4e2d\u9014\u5173\u95ed\u4e86\u5bfc\u81f4\u3002<\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n \u89e3\u51b3\u529e\u6cd5<\/span><\/strong><\/span><\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n \u3000\u3000\u7136\u540e\uff0c\u518d\uff0c\u68c0\u6d4b\u4e0b\u8fd9\u4e2a\u8868execution_flows\u8868\u7684\u72b6\u6001\u60c5\u51b5\uff0c\u5982\u4e0b\u51fa\u73b0\u9519\u8bef\u7684\u72b6\u6001\u662f\u6b63\u786e\u7684\uff0c\u672c\u6765\u8fd9\u4e2a\u8868\u5c31\u5df2\u7ecf\u662f\u4e0d\u5065\u5eb7\u7684\u4e86\u3002<\/p>\n <\/p>\n \u3000\u3000<\/p>\n <\/p>\n <\/p>\n <\/p>\n \u3000\u3000\u6267\u884c\uff0c\u4fee\u590d<\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n[hadoop@master bin]$ .\/azkaban-web-start.sh \nUsing Hadoop <\/span>from<\/span> \/home\/hadoop\/app\/hadoop-2.6<\/span>.0<\/span>\nUsing Hive <\/span>from<\/span> \/home\/hadoop\/app\/hive\n.<\/span>\/..\n<\/span>\/home\/hadoop\/app\/jdk\/lib:.:\/home\/hadoop\/app\/jdk\/lib:\/home\/hadoop\/app\/jdk\/jre\/lib:.\/..\/lib\/azkaban-2.5<\/span>.0<\/span>.jar:.\/..\/lib\/commons-collections-3.2<\/span>.1<\/span>.jar:.\/..\/lib\/commons-configuration-1.8<\/span>.jar:.\/..\/lib\/commons-dbcp-1.4<\/span>.jar:.\/..\/lib\/commons-dbutils-1.5<\/span>.jar:.\/..\/lib\/commons-email-1.2<\/span>.jar:.\/..\/lib\/commons-fileupload-1.2<\/span>.1<\/span>.jar:.\/..\/lib\/commons-io-2.4<\/span>.jar:.\/..\/lib\/commons-jexl-2.1<\/span>.1<\/span>.jar:.\/..\/lib\/commons-lang-2.6<\/span>.jar:.\/..\/lib\/commons-logging-1.1<\/span>.1<\/span>.jar:.\/..\/lib\/commons-pool-1.6<\/span>.jar:.\/..\/lib\/guava-13.0<\/span>.1<\/span>.jar:.\/..\/lib\/h2-1.3<\/span>.170<\/span>.jar:.\/..\/lib\/httpclient-4.2<\/span>.1<\/span>.jar:.\/..\/lib\/httpcore-4.2<\/span>.1<\/span>.jar:.\/..\/lib\/jackson-core-asl-1.9<\/span>.5<\/span>.jar:.\/..\/lib\/jackson-mapper-asl-1.9<\/span>.5<\/span>.jar:.\/..\/lib\/jetty-6.1<\/span>.26<\/span>.jar:.\/..\/lib\/jetty-util-6.1<\/span>.26<\/span>.jar:.\/..\/lib\/joda-time-2.0<\/span>.jar:.\/..\/lib\/jopt-simple-4.3<\/span>.jar:.\/..\/lib\/junit-4.8<\/span>.jar:.\/..\/lib\/log4j-1.2<\/span>.16<\/span>.jar:.\/..\/lib\/mail-1.4<\/span>.5<\/span>.jar:.\/..\/lib\/mysql-connector-java<\/a>-5.1<\/span>.28<\/span>.jar:.\/..\/lib\/servlet-api-2.5<\/span>.jar:.\/..\/lib\/slf4j-api-1.6<\/span>.1<\/span>.jar:.\/..\/lib\/slf4j-log4j12-1.6<\/span>.4<\/span>.jar:.\/..\/lib\/velocity-1.7<\/span>.jar:.\/..\/lib\/velocity-tools-2.0<\/span>.jar:.\/..\/extlib\/mysql-connector-java<\/a>-5.1<\/span>.21<\/span>.jar:.\/..\/plugins\/*<\/span>\/*.jar:\/home\/hadoop\/app\/hadoop-2.6.0\/conf:\/home\/hadoop\/app\/hadoop-2.6.0\/*:\/home\/hadoop\/app\/hive\/conf:\/home\/hadoop\/app\/hive\/lib\/*\n[hadoop@master bin]$ 2017\/07\/26 09:06:39.979 +0800 ERROR [AzkabanWebServer] [Azkaban] Starting Jetty Azkaban Executor...\n2017\/07\/26 09:06:40.098 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban settings file from .\/..\/conf\n2017\/07\/26 09:06:40.100 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban properties file\n2017\/07\/26 09:06:40.190 +0800 INFO [AzkabanWebServer] [Azkaban] Setting up Jetty Https Server with port:8443 and numThreads:25\nSLF4J: Class path contains multiple SLF4J bindings.\nSLF4J: Found binding in [jar:file:\/home\/hadoop\/app\/azkaban\/azkaban-web-2.5.0\/lib\/slf4j-log4j12-1.6.4.jar!\/org\/slf4j\/impl\/StaticLoggerBinder.class]\nSLF4J: Found binding in [jar:file:\/home\/hadoop\/app\/hive-1.0.0\/lib\/hive-jdbc-1.0.0-standalone.jar!\/org\/slf4j\/impl\/StaticLoggerBinder.class]\nSLF4J: See <\/span>http:\/\/www.slf4j.org\/codes.html<\/span>#multiple_bindings for an explanation.\n2017\/07\/26 09:06:40.484 +0800 INFO [log] [Azkaban] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog\n2017\/07\/26 09:06:41.013 +0800 INFO [AzkabanWebServer] [Azkaban] Loading user manager class azkaban.user.XmlUserManager\n2017\/07\/26 09:06:41.477 +0800 INFO [XmlUserManager] [Azkaban] Loading user azkaban\n2017\/07\/26 09:06:41.484 +0800 INFO [XmlUserManager] [Azkaban] Loading user metrics\n2017\/07\/26 09:06:41.485 +0800 INFO [XmlUserManager] [Azkaban] Loading user admin\nException in thread \"main\" azkaban.executor.ExecutorManagerException: Error fetching active flows\n<\/span><\/strong> at azkaban.executor.JdbcExecutorLoader.fetchActiveFlows(JdbcExecutorLoader.java:209)\n at azkaban.executor.ExecutorManager.loadRunningFlows(ExecutorManager.java:146)\n at azkaban.executor.ExecutorManager.<init>(ExecutorManager.java:84)\n at azkaban.webapp.AzkabanWebServer.loadExecutorManager(AzkabanWebServer.java:248)\n at azkaban.webapp.AzkabanWebServer.<init>(AzkabanWebServer.java:185)\n at azkaban.webapp.AzkabanWebServer.main(AzkabanWebServer.java:726)\nCaused by: java.sql.SQLException: Table 'execution_flows' is marked as crashed and should be repaired Query: SELECT ex.exec_id exec_id, ex.enc_type enc_type, ex.flow_data flow_data, ax.host host, ax.port port, ax.update_time axUpdateTime FROM execution_flows ex INNER JOIN active_executing_flows ax ON ex.exec_id = ax.exec_id Parameters: []\n<\/span><\/strong> at org.apache.commons.dbutils.AbstractQueryRunner.rethrow(AbstractQueryRunner.java:363)\n at org.apache.commons.dbutils.QueryRunner.query(QueryRunner.java:350)\n at org.apache.commons.dbutils.QueryRunner.query(QueryRunner.java:306)\n at azkaban.executor.JdbcExecutorLoader.fetchActiveFlows(JdbcExecutorLoader.java:202)\n ... 5 more<\/span><\/pre>\n
\n\u8fd8\u6709\u8bf4\u6cd5\u4e3a\u662fMYSQL\u6570\u636e\u5e93\u56e0\u4e3a\u67d0\u79cd\u539f\u56e0\u800c\u53d7\u5230\u4e86\u635f\u574f\uff0c\u5982\uff1a\u6570\u636e\u5e93\u670d\u52a1\u5668\u7a81\u53d1\u6027\u7684\u65ad\u7535\u3001\u5728\u63d0\u5728\u6570\u636e\u5e93\u8868\u63d0\u4f9b\u670d\u52a1\u65f6\u5bf9\u8868\u7684\u539f\u6587\u4ef6\u8fdb\u884c\u67d0\u79cd\u64cd\u4f5c\u90fd\u6709\u53ef\u80fd\u5bfc\u81f4
\nMYSQL\u6570\u636e\u5e93\u8868\u88ab\u635f\u574f\u800c\u65e0\u6cd5\u8bfb\u53d6\u6570\u636e\u3002\u603b\u4e4b\u5c31\u662f\u56e0\u4e3a\u67d0\u4e9b\u4e0d\u53ef\u6d4b\u7684\u95ee\u9898\u9020\u6210\u8868\u7684\u635f\u574f\u3002<\/p>\n[hadoop@master ~]$ mysql -uroot -prootroot\nWelcome to the MySQL monitor. Commands end with ; or \\g.\nYour MySQL connection id <\/span>is<\/span> 24<\/span>\nServer version: <\/span>5.1<\/span>.73<\/span> Source distribution\n\nCopyright (c) <\/span>2000<\/span>, 2013<\/span>, Oracle and\/or its affiliates. All rights reserved.\n\nOracle <\/span>is<\/span> a registered trademark of Oracle Corporation and\/or its\naffiliates. Other names may be trademarks of their respective\nowners.\n\nType <\/span>'<\/span>help;<\/span>'<\/span> or '<\/span>\\h<\/span>'<\/span> for<\/span> help. Type '<\/span>\\c<\/span>'<\/span> to clear the current input statement.\n\nmysql<\/span>> show databases;\n<\/span>+--------------------+\n| Database |\n+--------------------+\n| information_schema |\n| azkaban |\n| hive |\n| mysql |\n| test |\n+--------------------+\n5<\/span> rows in<\/span> set<\/span> (0.09<\/span> sec)\n\nmysql<\/span>> use azkaban\nReading table information <\/span>for<\/span> completion of table and column names\nYou can turn off <\/span>this<\/span> feature to get<\/span> a quicker startup with -A\n\nDatabase changed\nmysql<\/span>> show tables;\n<\/span>+------------------------+\n| Tables_in_azkaban |\n+------------------------+\n| active_executing_flows |\n| active_sla |\n| execution_flows |\n| execution_jobs |\n| execution_logs |\n| project_events |\n| project_files |\n| project_flows |\n| project_permissions |\n| project_properties |\n| project_versions |\n| projects |\n| properties |\n| schedules |\n| triggers |\n+------------------------+\n15<\/span> rows in<\/span> set<\/span> (0.00<\/span> sec)\n\nmysql<\/span>> <\/pre>\n
mysql> check table execution_flows;\n<\/span>+-------------------------+-------+----------+----------------------------------------------------------+\n| Table | Op | Msg_type | Msg_text |\n+-------------------------+-------+----------+----------------------------------------------------------+\n| azkaban.execution_flows | check | warning | 6<\/span> clients are using<\/span> or haven'<\/span>t closed the table properly |<\/span>\n| azkaban.execution_flows | check | error | Wrong bytesec: 40<\/span>-0<\/span>-0<\/span> at linkstart: 53868<\/span> |\n| azkaban.execution_flows | check | error | Corrupt |\n+-------------------------+-------+----------+----------------------------------------------------------+\n3<\/span> rows in<\/span> set<\/span> (0.40<\/span> sec)<\/pre>\n
mysql> repair table execution_flows;\n<\/span>+-------------------------+--------+----------+-------------------------------------------------------+\n| Table | Op | Msg_type | Msg_text |\n+-------------------------+--------+----------+-------------------------------------------------------+\n| azkaban.execution_flows | repair | info | Wrong bytesec: 40<\/span>- 0<\/span>- 0<\/span> at 53868<\/span>; Skipped |\n| azkaban.execution_flows | repair | info | Found block that points outside data file at 49260<\/span> |\n| azkaban.execution_flows | repair | info | Found block that points outside data file at 49472<\/span> |\n| azkaban.execution_flows | repair | info | Found block that points outside data file at 49476<\/span> |\n| azkaban.execution_flows | repair | info | Found block with too small length at 49628<\/span>; Skipped |\n| azkaban.execution_flows | repair | info | Found block that points outside data file at 49812<\/span> |\n| azkaban.execution_flows | repair | info | Found block that points outside data file at 49824<\/span> |\n| azkaban.execution_flows | repair | info | Found block that points outside data file at 49876<\/span> |\n| azkaban.execution_flows | repair | info | Wrong block with wrong total length starting at 49996<\/span> |\n| azkaban.execution_flows | repair | info | Found block that points outside data file at 50024<\/span> |\n| azkaban.execution_flows | repair | info | Found block that points outside data file at 50100<\/span> |\n| azkaban.execution_flows | repair | info | Found block that points outside data file at 50120<\/span> |\n| azkaban.execution_flows | repair | info | Found block that points outside data file at 50128<\/span> |\n| azkaban.execution_flows | repair | info | Found block that points outside data file at 50304<\/span> |\n| azkaban.execution_flows | repair | info | Found block that points outside data file at 50588<\/span> |\n| azkaban.execution_flows | repair | info | Found block that points outside data file at 50772<\/span> |\n| azkaban.execution_flows | repair | info | Found block that points outside data file at 51380<\/span> |\n| azkaban.execution_flows | repair | warning | Number of rows changed from<\/span> 74<\/span> to 71<\/span> |\n| azkaban.execution_flows | repair | status | OK |\n+-------------------------+--------+----------+-------------------------------------------------------+\n19<\/span> rows in<\/span> set<\/span> (0.36<\/span> sec)<\/pre>\n
mysql> check table execution_flows;\n<\/span>+-------------------------+-------+----------+----------+\n| Table | Op | Msg_type | Msg_text |\n+-------------------------+-------+----------+----------+\n| azkaban.execution_flows | check | status | OK |\n+-------------------------+-------+----------+----------+\n1<\/span> row in<\/span> set<\/span> (0.00<\/span> sec)<\/pre>\n