azkaban 部署

鸡汤: 人生的道路上,你没有耐心去等待成功,那么你只有用一生去面对失败。

1. 准备

1.1 包准备

 &esmp;将Azkaban Web服务器、Azkaban执行服务器和MySQL拷贝到虚拟机/usr/local/src/azkaban目录下

[root@master zkaban]# ll|awk '{print $NF}'
98600
azkaban-executor-server-2.5.0.tar.gz
azkaban-sql-script-2.5.0.tar.gz
azkaban-web-server-2.5.0.tar.gz
mysql-libs.zip
[root@master zkaban]# pwd
/usr/local/src/zkaban

1.2 数据库准备

  目前azkaban只支持 mysql,需安装mysql服务器,本文档中默认已安装好mysql服务器,并建立了 root用户,密码 root。

2. 安装azkaban

快速命令

cd /usr/local/azkaban/
mkdir -p /usr/local/azkaban/
tar xf azkaban-web-server-2.5.0.tar.gz -C /usr/local/azkaban/
tar xf azkaban-executor-server-2.5.0.tar.gz -C /usr/local/azkaban/
tar xf azkaban-sql-script-2.5.0.tar.gz -C /usr/local/azkaban/
cd /usr/local/azkaban/
ln -sf azkaban-web-2.5.0 server
ln -sf azkaban-executor-2.5.0 executor
详细过程
[root@master src]# cd zkaban/
[root@master zkaban]# ls
azkaban-executor-server-2.5.0.tar.gz  azkaban-sql-script-2.5.0.tar.gz  azkaban-web-server-2.5.0.tar.gz  mysql-libs.zip
[root@master zkaban]# ll
total 98600
-rw-r--r-- 1 root root 11157302 Feb 16  2017 azkaban-executor-server-2.5.0.tar.gz
-rw-r--r-- 1 root root     1928 Feb 16  2017 azkaban-sql-script-2.5.0.tar.gz
-rw-r--r-- 1 root root 11989669 Feb 16  2017 azkaban-web-server-2.5.0.tar.gz
-rw-r--r-- 1 root root 77807942 Mar  3  2017 mysql-libs.zip
[root@master zkaban]# mkdir -p /usr/local/azkaban
[root@master zkaban]# tar -zxvf azkaban-web-server-2.5.0.tar.gz -C /usr/local/azkaban/
[root@master zkaban]# tar -xf azkaban-executor-server-2.5.0.tar.gz -C /usr/local/azkaban/
[root@master zkaban]# tar -xf azkaban-sql-script-2.5.0.tar.gz -C /usr/local/azkaban/
[root@master zkaban]# cd /usr/local/azkaban/
[root@master azkaban]# ln -sf azkaban-web-2.5.0 server
[root@master azkaban]# ln -sf azkaban-executor-2.5.0 executor

2.2 数据导入

  azkaban脚本导入,进入mysql,创建azkaban数据库,并将解压的脚本导入到azkaban数据库。

快速部署

source /usr/local/azkaban/server/create-all-sql-2.5.0.sql
详细操作
[root@master azkaban]# pwd
/usr/local/azkaban
[root@master azkaban]# ls /usr/local/azkaban/server/create-all-sql-2.5.0.sql 
/usr/local/azkaban/server/create-all-sql-2.5.0.sql
[root@master azkaban]# mysql -uroot -proot
mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 751
Server version: 5.7.26 MySQL Community Server (GPL)

Copyright (c) 2000, 2019, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> create database azkaban;
Query OK, 1 row affected (0.02 sec)

mysql> use azkaban;
Database changed
mysql> source /usr/local/azkaban/server/create-all-sql-2.5.0.sql
Query OK, 0 rows affected (0.07 sec)

Query OK, 0 rows affected (0.02 sec)

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.02 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.02 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.00 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.02 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.00 sec)

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)

mysql> show tables;
+------------------------+
| Tables_in_azkaban      |
+------------------------+
| active_executing_flows |
| active_sla             |
| execution_flows        |
| execution_jobs         |
| execution_logs         |
| project_events         |
| project_files          |
| project_flows          |
| project_permissions    |
| project_properties     |
| project_versions       |
| projects               |
| properties             |
| schedules              |
| triggers               |
+------------------------+
15 rows in set (0.00 sec)
mysql> exit
Bye

2.3 证书制作

cd /usr/local/azkaban/server/
keytool -keystore keystore -alias jetty -genkey -keyalg RSA
详细操作
[root@master server]# cd
[root@master ~]# cd /usr/local/azkaban/server/
[root@master server]# keytool -keystore keystore -alias jetty -genkey -keyalg RSA
Enter keystore password:          <---- 输入一个密码[推荐000000,后面配置文件会用到]
Re-enter new password:            <---- 重复输入
What is your first and last name?
  [Unknown]:    <----  回车
What is the name of your organizational unit?
  [Unknown]:    <----  回车
What is the name of your organization?
  [Unknown]:    <----  回车
What is the name of your City or Locality?
  [Unknown]:    <----  回车
What is the name of your State or Province?
  [Unknown]:    <----  回车
What is the two-letter country code for this unit?
  [Unknown]:    <----  回车
Is CN=Unknown, OU=Unknown, O=Unknown, L=Unknown, ST=Unknown, C=Unknown correct?
  [no]:  y      <----  输入y回车

Enter key password for <jetty>
    (RETURN if same as keystore password):   <----  输入之前密码 000000
Re-enter new password:                       <----  再次输入密码 000000

Warning:
keystore keystore -destkeystore keystore -deststoretype pkcs12".
[root@master server]# ls
azkaban.version  bin  conf  extlib  keystore  lib  plugins  web
[root@master server]# ecll
-bash: ecll: command not found
[root@master server]# ll
total 12
-rw-r--r-- 1 root root  105 Apr 22  2014 azkaban.version
drwxr-xr-x 2 root root  112 Apr 22  2014 bin
drwxr-xr-x 2 root root   57 Aug 13 11:14 conf
drwxr-xr-x 2 root root    6 Apr 22  2014 extlib
-rw-r--r-- 1 root root 2244 Aug 13 11:16 keystore
drwxr-xr-x 2 root root 4096 Aug 13 11:14 lib
drwxr-xr-x 2 root root    6 Apr 22  2014 plugins
drwxr-xr-x 6 root root   73 Aug 13 11:14 web
[root@master server]# du -sh keystore 
4.0K    keystore

2.4 时间同步

   所有机器时间都要同步一致。省略,因为我新机器优化,已经配置过了。

2.5 配置文件修改

2.5.1 Web服务器配置

[root@master server]# cd ..
[root@master azkaban]# ls
azkaban-2.5.0  azkaban-executor-2.5.0  azkaban-web-2.5.0  executor  server
[root@master azkaban]# cd server/
[root@master server]# ll
total 16
-rw-r--r-- 1 root root  105 Apr 22  2014 azkaban.version
drwxr-xr-x 3 root root  179 Aug 13 11:40 bin
drwxr-xr-x 2 root root   57 Aug 13 11:34 conf
-rw-r--r-- 1 root root    7 Aug 13 11:40 currentpid
drwxr-xr-x 2 root root    6 Apr 22  2014 extlib
-rw-r--r-- 1 root root 2244 Aug 13 11:16 keystore
drwxr-xr-x 2 root root 4096 Aug 13 11:14 lib
drwxr-xr-x 2 root root    6 Apr 22  2014 plugins
drwxr-xr-x 6 root root   73 Aug 13 11:14 web
[root@master server]# cd conf/
[root@master conf]# ls
azkaban.properties  azkaban-users.xml

2.5.2 执行服务器配置

修改解释如下:

[root@master conf]# cat azkaban-users.xml 
<azkaban-users>
    <user username="azkaban" password="azkaban" roles="admin" groups="azkaban" />
    <user username="metrics" password="metrics" roles="metrics"/>
    <user username="admin" password="admin" roles="admin,metrics" />    
    <role name="admin" permissions="ADMIN" />
    <role name="metrics" permissions="METRICS"/>
</azkaban-users>

<user username="admin" password="admin" roles="admin,metrics" /> 用户名和密码都会admin

[root@master conf]# egrep -v '#|^$' azkaban.properties 
azkaban.name=Test                           # 服务器UI名称,用于服务器上方显示的名字
azkaban.label=My Local Azkaban              # 描述
azkaban.default.servlet.path=/index
web.resource.dir=/usr/local/azkaban/server/web/   # 默认web 目录
default.timezone.id=Asia/Shanghai                 # 时区
user.manager.class=azkaban.user.XmlUserManager    # 用户权限管理默认类
user.manager.xml.file=/usr/local/azkaban/server/conf/azkaban-users.xml  # 配置文件[要使用绝对路径]
executor.global.properties=/usr/local/azkaban/server/conf/global.properties # 配置文件[要使用绝对路径]
azkaban.project.dir=projects
database.type=mysql      # 数据库类型(目前只支持mysql)
mysql.port=3306          # mysql 端口
mysql.host=master        # mysql的ip/域名
mysql.database=azkaban   # mysql创建的库
mysql.user=root          # 链接mysql 用户
mysql.password=root      # 链接mysql 密码
mysql.numconnections=100 # 最大链接数
velocity.dev.mode=false
jetty.maxThreads=25
jetty.ssl.port=8443      # web端口
jetty.port=8081
jetty.keystore=/usr/local/azkaban/server/keystore   # 证书地址[要使用绝对路径]
jetty.password=000000    # 制作证书的密码
jetty.keypassword=000000 # 制作证书的密码
jetty.truststore=/usr/local/azkaban/server/keystore # 证书地址[要使用绝对路径]
jetty.trustpassword=000000 # 制作证书的密码
executor.port=12321
mail.sender=
mail.host=
job.failure.email=
job.success.email=
lockdown.create.projects=false
cache.directory=cache

可以配置smtp邮箱,可以发邮件

2.6 启动

  • 启动web服务器
详细操作
[root@master bin]# ./azkaban-web-start.sh 
Using Hadoop from 
Using Hive from /usr/local/hive
./..
.:/usr/local/jdk1.8.0_172/lib/dt.jar:/usr/local/jdk1.8.0_172/lib/tools.jar:./../lib/azkaban-2.5.0.jar:./../lib/commons-collections-3.2.1.jar:./../lib/commo
commons-dbcp-1.4.jar:./../lib/commons-dbutils-1.5.jar:./../lib/commons-email-1.2.jar:./../lib/commons-fileupload-1.2.1.jar:./../lib/commons-io-2.4.jar:./..ib/commons-lang-2.6.jar:./../lib/commons-logging-1.1.1.jar:./../lib/commons-pool-1.6.jar:./../lib/guava-13.0.1.jar:./../lib/h2-1.3.170.jar:./../lib/httpcli2.1.jar:./../lib/jackson-core-asl-1.9.5.jar:./../lib/jackson-mapper-asl-1.9.5.jar:./../lib/jetty-6.1.26.jar:./../lib/jetty-util-6.1.26.jar:./../lib/joda-ti3.jar:./../lib/junit-4.8.jar:./../lib/log4j-1.2.16.jar:./../lib/mail-1.4.5.jar:./../lib/mysql-connector-java-5.1.28.jar:./../lib/servlet-api-2.5.jar:./../lf4j-log4j12-1.6.4.jar:./../lib/velocity-1.7.jar:./../lib/velocity-tools-2.0.jar:./../extlib/*.jar:./../plugins/*/*.jar:/conf:/*:/usr/local/hive/conf:/usr/l[root@master bin]# 2019/08/13 11:40:03.262 +0800 ERROR [AzkabanWebServer] [Azkaban] Starting Jetty Azkaban Executor...
2019/08/13 11:40:03.275 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban settings file from ./../conf
2019/08/13 11:40:03.276 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban properties file
2019/08/13 11:40:03.288 +0800 INFO [AzkabanWebServer] [Azkaban] Setting up Jetty Https Server with port:8443 and numThreads:25
2019/08/13 11:40:03.313 +0800 INFO [log] [Azkaban] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2019/08/13 11:40:03.340 +0800 INFO [AzkabanWebServer] [Azkaban] Loading user manager class azkaban.user.XmlUserManager
2019/08/13 11:40:03.406 +0800 INFO [XmlUserManager] [Azkaban] Loading user azkaban
2019/08/13 11:40:03.407 +0800 INFO [XmlUserManager] [Azkaban] Loading user metrics
2019/08/13 11:40:03.407 +0800 INFO [XmlUserManager] [Azkaban] Loading user admin
2019/08/13 11:40:03.786 +0800 INFO [AzkabanWebServer] [Azkaban] Loading JDBC for project management
2019/08/13 11:40:03.787 +0800 INFO [ExecutorManager] [Azkaban] Cleaning old logs from execution_logs
2019/08/13 11:40:03.792 +0800 INFO [ProjectManager] [Azkaban] Project version retention is set to 3
2019/08/13 11:40:04.027 +0800 INFO [ExecutorManager] [Azkaban] Cleaning old log files before 2019-05-21T11:40:03.798+08:00
2019/08/13 11:40:04.034 +0800 INFO [ExecutorManager] [Azkaban] Cleaned up 0 log entries.
2019/08/13 11:40:04.078 +0800 INFO [TriggerManager] [Azkaban] TriggerManager loaded.
2019/08/13 11:40:04.078 +0800 INFO [AzkabanWebServer] [Azkaban] Loading built-in checker and action types
2019/08/13 11:40:04.082 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker BasicTimeChecker
2019/08/13 11:40:04.082 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker SlaChecker
2019/08/13 11:40:04.082 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker ExecutionChecker
2019/08/13 11:40:04.082 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action ExecuteFlowAction
2019/08/13 11:40:04.082 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action KillExecutionAction
2019/08/13 11:40:04.082 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action AlertAction
2019/08/13 11:40:04.082 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action CreateTriggerAction
2019/08/13 11:40:04.082 +0800 INFO [AzkabanWebServer] [Azkaban] Loading trigger based scheduler
2019/08/13 11:40:04.085 +0800 INFO [AzkabanWebServer] [Azkaban] Loading plug-in checker and action types
2019/08/13 11:40:04.085 +0800 ERROR [AzkabanWebServer] [Azkaban] plugin path plugins/triggers doesn't exist!
2019/08/13 11:40:04.085 +0800 INFO [AzkabanWebServer] [Azkaban] Setting timezone to Asia/Shanghai
2019/08/13 11:40:04.085 +0800 INFO [AzkabanWebServer] [Azkaban] Registering MBeans...
2019/08/13 11:40:04.104 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxJettyServer registered.
2019/08/13 11:40:04.106 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxTriggerManager registered.
2019/08/13 11:40:04.108 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxExecutorManager registered.
2019/08/13 11:40:04.111 +0800 INFO [AzkabanWebServer] [Azkaban] Setting up web resource dir /usr/local/azkaban/server/web/
2019/08/13 11:40:04.159 +0800 INFO [JdbcTriggerLoader] [Azkaban] Loading all triggers from db.
2019/08/13 11:40:04.188 +0800 INFO [JdbcTriggerLoader] [Azkaban] Loaded 0 triggers.
2019/08/13 11:40:04.189 +0800 INFO [log] [Azkaban] jetty-6.1.26
2019/08/13 11:40:04.441 +0800 INFO [log] [Azkaban] Started SslSocketConnector@0.0.0.0:8443
2019/08/13 11:40:04.441 +0800 INFO [AzkabanWebServer] [Azkaban] Server running on ssl port 8443.
  • 启动执行服务器
cd /usr/local/azkaban/executor/bin/
./azkaban-executor-start.sh
执行过程
[root@master bin]# ./azkaban-executor-start.sh 
Using Hadoop from 
Using Hive from /usr/local/hive
./..
f4j-log4j12-1.6.4.jar:./../lib/velocity-1.7.jar:./../lib/velocity-tools-2.0.jar:./../extlib/*.jar:./../plugins/*/*.jar:/conf:/*:/usr/local/hive/conf:/usr/local/hive/lib/*
Starting AzkabanExecutorServer on port 12321 ...
[root@master bin]# 2019/08/13 11:38:04.346 +0800 ERROR [AzkabanExecutorServer] [Azkaban] Starting Jetty Azkaban Executor...
2019/08/13 11:38:04.363 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban settings file from ./../conf
2019/08/13 11:38:04.363 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban private properties file
2019/08/13 11:38:04.365 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban properties file
2019/08/13 11:38:04.379 +0800 INFO [AzkabanExecutorServer] [Azkaban] Setting timezone to Asia/Shanghai
2019/08/13 11:38:04.401 +0800 INFO [log] [Azkaban] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2019/08/13 11:38:04.485 +0800 INFO [FlowRunnerManager] [Azkaban] Execution dir retention set to 86400000 ms
2019/08/13 11:38:04.487 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 11:38:04.487 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 11:38:04.487 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old execution dirs
2019/08/13 11:38:04.493 +0800 INFO [AzkabanExecutorServer] [Azkaban] Registering MBeans...
2019/08/13 11:38:04.505 +0800 INFO [AzkabanExecutorServer] [Azkaban] Bean azkaban.jmx.JmxJettyServer registered.
2019/08/13 11:38:04.507 +0800 INFO [AzkabanExecutorServer] [Azkaban] Bean azkaban.jmx.JmxFlowRunnerManager registered.
2019/08/13 11:38:04.507 +0800 INFO [log] [Azkaban] jetty-6.1.26
2019/08/13 11:38:04.549 +0800 INFO [log] [Azkaban] Started SocketConnector@0.0.0.0:12321
2019/08/13 11:38:04.550 +0800 INFO [AzkabanExecutorServer] [Azkaban] Azkaban Executor Server started on port 12321
2019/08/13 11:40:04.489 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished

[root@master bin]# 2019/08/13 11:42:04.492 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 11:43:04.493 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 11:44:04.493 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 11:46:04.494 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 11:48:04.496 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 11:48:04.497 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 11:50:04.500 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 11:52:04.502 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 11:53:04.502 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 11:54:04.503 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 11:56:04.504 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 11:58:04.505 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 11:58:04.506 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 12:00:04.508 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:02:04.511 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:03:04.512 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 12:04:04.514 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:06:04.519 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:08:04.522 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:08:04.522 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 12:10:04.524 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:12:04.525 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:13:04.528 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 12:14:04.529 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:16:04.531 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:18:04.533 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:18:04.533 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 12:20:04.535 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:22:04.537 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:23:04.538 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 12:24:04.539 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:26:04.542 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:28:04.543 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:28:04.543 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 12:30:04.545 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:32:04.548 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:33:04.548 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 12:34:04.550 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:36:04.554 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:38:04.556 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:38:04.557 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 12:38:04.557 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old execution dirs
2019/08/13 12:40:04.559 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:42:04.560 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:43:04.561 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 12:44:04.562 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:46:04.565 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:48:04.567 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:48:04.569 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 12:50:04.570 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:52:04.573 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:53:04.574 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 12:54:04.575 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:56:04.577 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:58:04.580 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 12:58:04.581 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 13:00:04.581 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:02:04.584 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:03:04.585 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 13:04:04.588 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:06:04.589 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:08:04.590 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:08:04.590 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 13:10:04.593 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:12:04.596 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:13:04.597 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 13:14:04.598 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:16:04.600 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:18:04.605 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:18:04.605 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 13:20:04.607 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:22:04.609 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:23:04.611 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 13:24:04.612 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:26:04.614 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:28:04.616 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:28:04.616 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 13:30:04.618 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:32:04.624 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2019/08/13 13:33:04.625 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2019/08/13 13:34:04.627 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished

[root@master bin]# 
  • 查询
[root@master bin]# jps
37828 ResourceManager
109029 Jps
37670 SecondaryNameNode
37481 NameNode
26334 Master
68879 QuorumPeerMain
99967 AzkabanExecutorServer
100126 AzkabanWebServer

注意启动顺序

2.7 登录

  启动完成后,在浏览器(建议使用谷歌浏览器)中输入https://服务器IP地址:8443,即可访问azkaban服务了。在登录中输入刚才新的户用名及密码,点击 login。

azkaban azkaban azkaban