日志采集工具，支持正则热加载日志文件，发送状态等信息都会实时上报ETCD
TODO将日志文件一行一行读取出来发送到自定义的Sink|100%支持自动重试（fib）心跳检测发送到自定义的Topic[health]|100%日志启动点(创建CheckPoint)|100%Offset同步到Etcd|100%Web监控心跳以及创建新的采集任务|100%热启动插件|10%Logs-采集工具./Logs_Pulseinstall--安装服务./Logs_Pulsestart--启动服务./Logs_Pulsestop--停止服务./Logs_Pulserestart--重启服务Owner邮箱echoemhhbmdqaWFueGlubmV0QGdtYWlsLmNvbQo=|base64--decode命令行客户端使用教程(base)➜cli./cliNAME:pulseclient-atoolfordrivingpulsecliUSAGE:cli[globaloptions]command[commandoptions][arguments...]VERSION:v1darwin/amd64go1.11.4AUTHOR:Zhangjianxin<zhangjianxinnet@gmail.com>COMMANDS:listpulseonetcdconfigservicespulseonservicestaskaddtaskonservicescleardeleterootpath/datahosthostlisthelp,hShowsalistofcommandsorhelpforonecommandGLOBALOPTIONS:--help,-hshowhelp--version,-vprinttheversion(base)➜cli./clihost|---------------||Host||---------------||192.168.2.150||---------------||192.168.2.150||---------------||192.168.2.150||---------------||192.168.2.150||---------------|(base)➜cli./clilist|-----------------------------------------------------------------------------------------------------------------------------------------------------||Topic|Log_path|Service|Send_rate|IP|Type||-----------------------------------------------------------------------------------------------------------------------------------------------------||test|/Users/zhangjianxin/home/GO_LIB/src/github.com/uk0/Octopoda/release/logs/est.log|sentry-test-service|1000|192.168.2.150|kafka||-----------------------------------------------------------------------------------------------------------------------------------------------------||test|/Users/zhangjianxin/home/GO_LIB/src/github.com/uk0/Octopoda/release/logs/est.log|sentry-test-service|1000|192.168.2.150|http||-----------------------------------------------------------------------------------------------------------------------------------------------------||test|/Users/zhangjianxin/home/GO_LIB/src/github.com/uk0/Octopoda/release/logs/est2.log|sentry-test-service|1000|192.168.2.150|http||-----------------------------------------------------------------------------------------------------------------------------------------------------|(base)➜cli./cliservices|------------------------------------------------------------------------------------------------------------------------------------------------------||Offset|FilePatch|Time|Topic|TPS|QPS|IP||------------------------------------------------------------------------------------------------------------------------------------------------------||39|/Users/zhangjianxin/home/GO_LIB/src/github.com/uk0/Octopoda/release/logs/est.log|2019-04-2703:38:32|test|0|0|192.168.2.150||------------------------------------------------------------------------------------------------------------------------------------------------------||63|/Users/zhangjianxin/home/GO_LIB/src/github.com/uk0/Octopoda/release/logs/est.log|2019-04-2703:45:17|test|0|0|192.168.2.150||------------------------------------------------------------------------------------------------------------------------------------------------------||87|/Users/zhangjianxin/home/GO_LIB/src/github.com/uk0/Octopoda/release/logs/est2.log|2019-04-2703:49:32|test|0|0|192.168.2.150||------------------------------------------------------------------------------------------------------------------------------------------------------|(base)➜cli./clitask-host192.168.43.223-tburied-point-mall-f/var/log/system.log-sburied-point-mall-service-test-phttp./clitask-re""-host192.168.2.150-tburied-point-mall-f/Users/zhangjianxin/home/GO_LIB/src/github.com/uk0/Octopoda/release/logs/-sburied-point-mall-service-test-phttp./clitask-re""-host172.17.193.23-tsentry-test-f/var/log/messages-sservice-test-phttp./clitask-re""-host172.19.184.193-tsentry-test-f/home/soft/Octopoda/release/logs/pulse.log-ssystem-pulse-phttp./clitask-re""-host172.19.184.193-tburied-point-mall-f/data/sa/-ssa-pulse-phttp./clitask-re""-host172.17.193.23-tsentry-test-f/home/Octopoda/release/logs/-sservice-test2-phttp./clitask-re""-host192.168.131.249-tburied-point-sma-r2p10-f/home/admin/app/logs/-sservice-test4-phttp./clitask-re""-host192.168.131.249-tburied-point-sma-r2p10-f/home/admin/app/logs/behaviorSave.log-sservice-test4-phttp./clitask-re""-host192.168.131.249-tsentry-test-f/home/Octopoda/release/logs/pulse.log-ssystem-pulse-phttp提交作业./clitask-host192.168.2.150#采集某个节点-ttest#发送到topic-f/var/log/system.log#采集日志-ssentry-test-service#服务名字定义-phttp#发送方式#createtopickafka-topics--create--zookeepercdh-m1.sxkj.online:2181--replication-factor1--partitions1--topickdc_pdpkerberosKDCProxyhttps://medium.com/@Santii/how-to-setup-kerberos-behind-a-reverse-proxy-nginx-d692f609191c
点击空白处退出提示
评论