...
- apache kakfa, kafka-rest
- rabbitmq, activemq
- redis, couchbase
- nosql database, rdbms
- s3, gcs
- hadoop, elasticsearch
- spark, athena, bigquery
- datalab, dataproc, dataflow
- kinesis, emr, redshift
- kibana, datastudio
- zeppelin
logstash
...
| icon | false |
|---|
<<기본실행>>
$logstash -f logstash.conf
<<config file구조>>
input {
file {
path => "file path (* 처리 가능)"
}
}
filter {
mutate { convert => {"user_id" => "Integer"}}
}
output {
elasticsearch {
index => "access-log-%{YYYY.MM.dd}"
host => "123.456.789.123:9200"
}
}
<<config test>>
$logstach -f logstash.conf --configtest