> docker exec -it airflow bash
    
>> airflow list_dags
>> airflow trigger_dag gatherdag1
# 실행중인 dag 가 없어야 함.
    
>>   접속: mysql -uroot -p

MariaDB [(none)]> set names utf8;
MariaDB [(none)]> use airflow;
MariaDB [airflow]> SELECT * FROM dag_run;
MariaDB [airflow]> UPDATE  dag SET  is_paused ='0' WHERE dag_id IN('gatherdag1','inferencedag1') AND is_paused ='1';
MariaDB [airflow]> SELECT * FROM job where  state NOT IN('failed','success');
MariaDB [airflow]> SELECT * FROM dag_run where  state NOT IN('failed','success');

MariaDB [airflow]> UPDATE job SET state = 'failed' where  state NOT IN('failed','success') ;
MariaDB [airflow]> UPDATE dag_run SET state = 'failed' where  state NOT IN('failed','success');

MariaDB [airflow]> commit;

# 이후 airflow web 화면에서 시작버튼 클릭

# 참조 : medium.com/@santosh.dadisetti/installing-the-docker-centos-apache-airflow-with-mysql-backend-1c99544d6692

Installing Docker + Centos + Apache Airflow with Mysql Backend

Pulling latest Centos OS from Docker hub
docker pull centos:latest
docker run -it — net=host — name airflow_server -p 8080:8080 -p 5555:5555 centos
upgrade centos OS on Docker
yum install epel-release -y
yum install gcc-c++ -y
yum install -y mysql-devel python-devel python-setuptools
install Python3.6
yum -y install https://centos7.iuscommunity.org/ius-release.rpm
yum -y install python36u
Install PIP for Python 3.6
yum -y install python36u-pip
Update Python development tools
yum -y install python36u-devel
Upgrade setuptools if needed.
pip3.6 install — upgrade pip
pip install — upgrade setuptools
Basics python packages for Apache Airflow
pip install -U pip setuptools wheel
pip install pytz
pip install pyOpenSSL
pip install ndg-httpsclient

One of the dependencies of Apache Airflow by default pulls in a GPL library (‘unidecode’). In case this is a concern you can force a non GPL library by issuing export SLUGIFY_USES_TEXT_UNIDECODE=yes and then proceed with the normal installation
https://airflow.apache.org/installation.html
export SLUGIFY_USES_TEXT_UNIDECODE=yes
install Apache Airflow
pip install apache-airflow
Intiating Airflow DB , by default Apache airflow use Sqllite
airflow initdb
Export Airflow_home to /root/airflow
export AIRFLOW_HOME=/root/airflow
Start Apache Airflow webserver
airflow webserver -p 8080
Set up Mysql as backend/Metadata DB for Apache Airflow
yum install mariadb-devel — skip-broken
pip install Apache-airflow[mysql]
on Mysql server
SET explicit_defaults_for_timestamp=1
Edit airflow.cfg on /root/airflow/airflow.cfg
# The SqlAlchemy connection string to the metadata database.
# SqlAlchemy supports many different database engine, more information
# their website
#sql_alchemy_conn = sqlite:////root/airflow/airflow.db
sql_alchemy_conn = mysql://<username>:<password>@<mysql-server>:3306/airflow
Reset/ initiate DB on airlfow
airflow initdb
and start Airflow Server
airflow webserver -p 8080

참조 : velog.io/@hongji3354/Docker%EB%A5%BC-%EC%82%AC%EC%9A%A9%ED%95%B4%EC%84%9C-MariaDB-%EC%84%A4%EC%B9%98%ED%95%98%EA%B8%B0

1) docker pull mariadb

2) docker run --name mariadb -d -p 3306:3306 -e MYSQL_ROOT_PASSWORD=mariadb mariadb

3) docker exec -it mariadb /bin/bash

4) mysql -u root -p

Enter password : mariadb

5) mysql > status

Latin1 으로 뜨는 데 utf8 로 변경

6) vi 가 없으므로 vi 부터 설치후, my.cnf 수정

apt-get update

apt-get install apt-file

apt-file update

apt list --upgradable

apt-get install vim

/etc/mysql/my.cnf 내에 아래 2줄 !includedir 이 있으면,
!includedir /etc/mysql/conf.d/
!includedir /etc/mysql/mariadb.conf.d/

cd /etc/mysql/mariadb.conf.d/
vi 50-client.cnf 50-mysql-clients.cnf 50-server.cnf

# 50-client.conf 에서
[client]
default-character-set = utf8mb4

# 50-mysql-cient.cnf 에서
[mysql]
default-character-set = utf8mb4

# 50-server.cnf 에서
[mysqld]
...
collation-server = utf8_unicode_ci
init-connect='SET NAMES utf8'
character-set-server = utf8
추가


/etc/mysql/my.cnf 내에 아래 2줄 !includedir 이 없으면 my.cnf 에 직접 추가

[client]
default-character-set = utf8mb4

[mysql]
default-character-set = utf8mb4

[mysqld]
collation-server = utf8_unicode_ci
init-connect='SET NAMES utf8'
character-set-server = utf8

7) docker restart [CONTAINER ID]

docker exec -it mariadb /bin/bash

8) 

* AWS 에 설치하는 건 잘 안된다.

* mysql plugin 을 설치하려는데 오류가 나서 설치가 안된다. 그냥 직접 설치해봐야 할 듯 하다.

참조 : cofs.tistory.com/407

# 1. docker 설치
yum -y install docker docker-registry
systemctl enable docker.service
systemctl start docker.service


# 2. airflow officall Image download
docker pull puckel/docker-airflow

docker images

# 참고. save as tar

docker save ...

# 3. run airflow

docker run -d -p 8080:8080 --name airflow_v1 docker.io/puckel/docker-airflow 
docker ps

# 4. open firewall

console > vi /etc/firewalld/zones/public.xml 
<zone>
...
  <port protocol="tcp" port="8080"/>
  <port protocol="tcp" port="80"/>
</zone>

console > firewall-cmd --reload

# 참고 )
console > systemctl start firewalld
console > systemctl enable firewalld
console > systemctl stop firewalld
console > systemctl disable firewalld
console > firewall-cmd --state # 상태 확인
console > firewall-cmd --get-active-zones # 활성화 존 목록
console > firewall-cmd --get-service # 서비스 리스트
console > firewall-cmd --zone=public --list-services # public 존 서비스 리스트

# 5. login airflow

http://localhost:8080

#