...
- apache kakfa, kafka-rest
- rabbitmq, activemq
- redis, couchbase
- nosql database, rdbms
- s3, gcs
- hadoop, elasticsearch
- spark, athena, bigquery
- datalab, dataproc, dataflow
- kinesis, emr, redshift
- kibana, datastudio
- zeppelin
logstash
| Info | ||
|---|---|---|
| ||
<<기본실행>> $logstash -f logstash.conf <<config file구조>> input { file { path => "file path (* 처리 가능)" } } filter { mutate { convert => {"user_id" => "Integer"}} } output { elasticsearch { index => "access-log-%{YYYY.MM.dd}" host => "123.456.789.123:9200" } } <<config test>> $logstach -f logstash.conf --configtest |