uavorg / uavstack Goto Github PK

目前文档中只是说明了外部应用可以通过类似http://ip:port/hb/query 的接口来获取相应的数据但是并没有详细的说明该用何种请求方式和请求参数才能得到正确的数据，能否提供一个相应的文档来说明这些接口的调用方式呢。当然不只是这个心跳的查询接口

MSCP Feature Isolation Enhancement: to enhance the feature isolation level

need modify non-NodeServer's config , change feature.healthmanager.MT_Node.enable to false

Dubbo Provider miss the right IP. This issue happens in open source version. the FIX code should be merge into open source version.

FIX App Monitor Metrics Loss after opening an App Instance Metrics Window.

The reason is that the wrong customized App Instance Metrics Watch is actived, then the query only return the customized App Instance's Metrics data.

uav各位好：
现在有一个dubbo调用链需求：
需求背景：
dubbo支持随机端口-1的这种配置方式，目前UAVStack中收集的dubbo调用链路这种方式只能定位到业务应用服务器ip及端口，不能准确定位到dubbo服务注册在zk中的真实ip和端口。
需求描述：
当有rpc异常的时候，为了方便排除dubbo问题，应该首先定位是否哪个dubbo 服务报错了，而不是去先定位业务应用调用dubbo的机器，这样才能快速定位哪条dubbo调用链导致了异常。而不是 先找业务，在定位dubbo链路，侧重点应该在这边，麻烦考虑一下。谢谢！
辛苦！

1. The Connection of the old-version Mysql is a class, not a interface, so it need to be filtered
2. Add sql in heavy invokechain when statement execute "executeQuery" method.

springboot's hook couldn't take effect when the target class regist as bean , it will cause duplicate define class error

Source code compiling refinement for easy to compile MonitorAgent，MOF，HealthManager

FIX @WebServlet & @webfilter miss some url patterns

The code and performance optimization of OpenTSDB cluster management, including the repackaging of javascript files, the optimization of mobile terminal display, the operation performance improvement of OpenTSDB instances, and so on.

1. fix ma_pro config jta enable true
2. fix monitor agent pom.xml to copy jta jar only
3. fix jta collect task NPE
4. fix RuntimeNotify description miss current value
5. fix monitorframework config NetCardIndex default 0

是否能提供根据指标的环比、同比预警功能，比如在一个时间段内，当前一分钟订单总数比上一分钟下降了50%就预警

sometimes, like in springboot, the log4j-over-slf4j is used, see conflicts on method Logger.getLoggerRepository(), the sl4j doesn't have this method.

As our current hook only supports log4j, the detection is appended. Later, we will support sl4j hook

InvokeChain query can't reach over 7 days due to missing the indexdate on GUI params.

当存在多次动态打理时，uav 使用的java 动态代理方式有可能会调用失败。

As HIT is using the ProfileDataModel, the better solution is to unify the UAV.Monitor ProfileDataModel with HIT, so refactoring the ProfileDataModeling will make all ProfileDataModeling requirements usage

1.do threadAnalysis when notify event happened.
2.the result about threadAnalysis will be showed in threadAnalysis
result list.

UAV.Monitor doing app profile need to parse some XML file like web.xml，loading DTD file case java.net.SocketException if app can not connect to the Network

FIX SpringBoot AppID & Service Mapping Issue for SpringMVC
1.InstallHookJar中URL格式修改
2.ServiceMapBinding兼容springmvc Controller类注解无RequestMapping情况
3.springboot appid生产规则修改

uav全体：
您好，关于服务图谱中服务流调用访问次数的需求，目前只支持单个实例的访问次数统计，还有单个实例的总访问次数。但是更重要的是对于整个集群来说，意义更为重大！
需求：增加 集群总调用访问次数，历史访问总次数，同比环比错误率统计，实例同比环比错误率统计。
此需求价值更为重大，希望考虑增加！

add new menu of AppOS/Process Metrics Window to App/Service Monitor panel.

Then, the end user can watch its OS or Process Metrics by click the menu of App/Service Monitor panel.

This is a new collection chain between App Perf Metrics and its Env Perf Metrics

apphub iframe 跳转 # 识别不了，不刷新缓存，修改为：如果存在旧的则删除，每次创建新的
重调用链开启时JdbcDriverIT某些时候的空指针异常

Sometimes, users may only install MA without Application, current Machine Tags will only display MA without hostname.

we make an enhancement that when there is only MonitorAgent Tag, display the hostname.

在windows环境下设置属性JAppGroup为中文时显示乱码，在linux环境下显示正常。

重调用链添加对dubbo的支持优化

stop.sh,stop.bat can not shutdown MA process

FIX missing pom.xml in test project of com.creditease.uav.monitorframework.buildFat

OpenTSDB cluster management intergration

新增时空沙盘应用容器以及进程的性能指标显示，修复ptag查询与拷贝的BUG
1.在选中一个应用实例后，增加显示其对应机器IP的性能指标与其进程的性能指标
2.在时空沙盘查询,BUG在于，进行大类性能指标查询时，不能根据ptag将指标分类显示，如查询RC，不能出现显示结果 修改要点：对ptag加上""查询，并对大类指标进行判断，成功显示RC，RC*等指标。
3.在时空沙盘同一组指标查询时，BUG在于，若同时查询具有ptag的指标与不含ptag的指标时，前者会覆盖掉后者的tags，如同时点击应用实例RC和count性能指标，只显示RC的性能指标，并未显示应用实例的count性能指标。 修改要点：在help.js的merge方法中，拷贝方法为浅拷贝，但对于tags而言，只一个对象，故必须对其进行特殊处理，进行深拷贝。

FIX: append MonitorAgent, HealthManager AllinOne start.sh in their buildComponent.

AppHub web.xml config miss jta config

@url:uav.app.apm.jta.http.addr
http://localhost:5566

In the application container monitoring, the mscp node version number is undefined.It should be a number.

Support multiple thread dump.

Thread Analysis add a new "multi-thread dump" button that can invoke multiple thread dumps.

request couldn't be mapped to custom App 'com.creditease.uav' in tomcat6

UAV.Monitor add struts2 support:
UAV.Monitor support struts2 deployment descriptor & annotations
UAV.Monitor does not support struts2 Configuration by Convention

----Apphub user behavior record add info---
我们需要一份户用户在Apphub授权（匹配）的邮箱组和系统列表
1、在用户登录授权时：丰富用户session字段\内容：用户匹配的被授权的邮箱组和系统列表
2、用户行为日志（ulog）丰富字段、JS用户变量（前端同样可以获取登录用户数据）丰富字段

----- fix Apphub ajax assembly params not default----
1、apphub ajax contentType 添加默认类型：application/json; charset=UTF-8
2、原因描述：开启重调用链后，mof会对rs接口进行拦截处理，对没有定义上传参数的ajax提交请求，会使用默认处理。从而导致与rs接口不匹配，最终报错。

Support disk IO for Windows (win7 to 10) systems, disk IO for each service process

在tomcat中设置查看日志的路径，但是控制台没有采集到，ma麻烦查看一下
[2017-10-24 19:34:37:361] 94 D com.creditease.agent.feature.logagent.TaildirLogComponent.process(328) ### LogTailComponet stop process.###
[2017-10-24 19:34:37:361] 94 D com.creditease.agent.feature.logagent.TaildirLogComponent.process(255) ###LogTailComponet starting process.###
[2017-10-24 19:34:37:361] 94 D com.creditease.agent.feature.logagent.ReliableTaildirEventReader.updateTailFiles(428) tailfile mapping: 15728648 --> /app/apache-datax-7.0.70---/app/apache-datax-7.0.70-datax-console-/app/logs/com.gome.architect.datax-console/app.log
[2017-10-24 19:34:37:361] 94 D com.creditease.agent.feature.logagent.ReliableTaildirEventReader.updateTailFiles(428) tailfile mapping: 263021 --> /app/apache-datax-7.0.70---/app/apache-datax-7.0.70-manager-/app/apache-datax-7.0.70/logs/catalina.2017-10-24.log
[2017-10-24 19:34:37:361] 94 D com.creditease.agent.feature.logagent.ReliableTaildirEventReader.updateTailFiles(428) tailfile mapping: 782611 --> /app/apache-datax-7.0.70---/app/apache-datax-7.0.70-datax-console-/root/logs/tddl/tddl-dynamic.log
[2017-10-24 19:34:37:361] 94 D com.creditease.agent.feature.logagent.ReliableTaildirEventReader.updateTailFiles(428) tailfile mapping: 782610 --> /app/apache-datax-7.0.70---/app/apache-datax-7.0.70-datax-console-/root/logs/tddl/tddl-stat.log
[2017-10-24 19:34:37:361] 127 D this.addAllTask(60) ### TailFilesMutiJobs tf path:###/app/logs/com.gome.architect.datax-console/app.log
[2017-10-24 19:34:37:361] 127 D this.addAllTask(61) ### TailFilesMutiJobs tf needTail: ###false
[2017-10-24 19:34:37:361] 127 D this.addAllTask(60) ### TailFilesMutiJobs tf path:###/app/apache-datax-7.0.70/logs/catalina.2017-10-24.log
[2017-10-24 19:34:37:361] 127 D this.addAllTask(61) ### TailFilesMutiJobs tf needTail: ###false
[2017-10-24 19:34:37:361] 127 D this.addAllTask(60) ### TailFilesMutiJobs tf path:###/root/logs/tddl/tddl-dynamic.log
[2017-10-24 19:34:37:361] 127 D this.addAllTask(61) ### TailFilesMutiJobs tf needTail: ###false
[2017-10-24 19:34:37:362] 127 D this.addAllTask(60) ### TailFilesMutiJobs tf path:###/root/logs/tddl/tddl-stat.log
[2017-10-24 19:34:37:362] 127 D this.addAllTask(61) ### TailFilesMutiJobs tf needTail: ###false
[2017-10-24 19:34:37:362] 127 D this.startAllT(68) AbstractParallelJob tasks size is zero ##
[2017-10-24 19:34:37:362] 94 D com.creditease.agent.feature.logagent.TaildirLogComponent.process(328) ### LogTailComponet stop process.###
[2017-10-24 19:34:37:362] 63 D com.creditease.uav.messaging.impl.RMQMessageProducer.submit(119) Submit Message SUCCESS: msg {"iDString":"JQ_IVC-922664408679931904-1508844877305","messageType":"JQ_IVC","params":{"JQ_IVC":"[{"action":"JQ_IVC","appgroup":"UNKNOWN","eof":false,"file":"/app/data/uav/ivc/datax-console_8081_ivc.0.log","host":"vm-10-112-178-171","ip":"10.112.178.171","lines":[{"content":"10.112.178.171_8081_1508844876857_26_467;1;N;E;1508844876857;4;10.112.178.171:8081;datax-console;apache.http.Client,mtd=POST;com.taobao.diamond.client.impl.DefaultDiamondSubscriber;checkUpdateDataIds;/diamond-server/config.co;1%3F200","lnum":24312,"timestamp":1508844877305}],"target":"http://10.112.178.171:8081/datax-console---datax-console","time":1508844877305}]"},"systemId":"922664408679931904","timeStamp":1508844877305},topic={"JQ_IVC":["JQ_IVC"]}
[2017-10-24 19:34:37:362] 94 D com.creditease.agent.feature.logagent.TaildirLogComponent.process(255) ###LogTailComponet starting process.###
[2017-10-24 19:34:37:362] 94 D com.creditease.agent.feature.logagent.ReliableTaildirEventReader.updateTailFiles(428) tailfile mapping: 15728648 --> /app/apache-datax-7.0.70---/app/apache-datax-7.0.70-datax-console-/app/logs/com.gome.architect.datax-console/app.log
[2017-10-24 19:34:37:362] 94 D com.creditease.agent.feature.logagent.ReliableTaildirEventReader.updateTailFiles(428) tailfile mapping: 263021 --> /app/apache-datax-7.0.70---/app/apache-datax-7.0.70-manager-/app/apache-datax-7.0.70/logs/catalina.2017-10-24.log
[2017-10-24 19:34:37:362] 94 D com.creditease.agent.feature.logagent.ReliableTaildirEventReader.updateTailFiles(428) tailfile mapping: 782611 --> /app/apache-datax-7.0.70---/app/apache-datax-7.0.70-datax-console-/root/logs/tddl/tddl-dynamic.log
[2017-10-24 19:34:37:362] 94 D com.creditease.agent.feature.logagent.ReliableTaildirEventReader.updateTailFiles(428) tailfile mapping: 782610 --> /app/apache-datax-7.0.70---/app/apache-datax-7.0.70-datax-console-/root/logs/tddl/tddl-stat.log
[2017-10-24 19:34:37:362] 127 D this.addAllTask(60) ### TailFilesMutiJobs tf path:###/app/logs/com.gome.architect.datax-console/app.log
[2017-10-24 19:34:37:362] 127 D this.addAllTask(61) ### TailFilesMutiJobs tf needTail: ###false
[2017-10-24 19:34:37:362] 127 D this.addAllTask(60) ### TailFilesMutiJobs tf path:###/app/apache-datax-7.0.70/logs/catalina.2017-10-24.log
[2017-10-24 19:34:37:362] 127 D this.addAllTask(61) ### TailFilesMutiJobs tf needTail: ###true
[2017-10-24 19:34:37:362] 127 D this.addAllTask(60) ### TailFilesMutiJobs tf path:###/root/logs/tddl/tddl-dynamic.log
[2017-10-24 19:34:37:362] 127 D this.addAllTask(61) ### TailFilesMutiJobs tf needTail: ###false
[2017-10-24 19:34:37:362] 127 D this.addAllTask(60) ### TailFilesMutiJobs tf path:###/root/logs/tddl/tddl-stat.log
[2017-10-24 19:34:37:362] 127 D this.addAllTask(61) ### TailFilesMutiJobs tf needTail: ###false
[2017-10-24 19:34:37:362] 127 D this.startAllT(62) AbstractParallelJob tasks.size(): 1
[2017-10-24 19:34:37:362] 127 D com.creditease.agent.feature.logagent.TailFile.readEvents(267) ### Before Total LineNo:2
[2017-10-24 19:34:37:362] 127 D com.creditease.agent.feature.logagent.RuleFilterFactory$FilterAndRuleChain.doProcess(347) get log event - [Oct 24, 2017 7:34:36 PM com.creditease.tomcat.plus.util.TomcatLog doLog]
[2017-10-24 19:34:37:362] 127 D com.creditease.agent.feature.logagent.RuleFilterFactory$FilterAndRuleChain.doProcess(347) get log event - [INFO: 2017-10-24 19:34:36 [CE] INFO [MonitorServer] com.creditease.monitor.UAVMonitor.record [26(pool-3-thread-1)] UAV.MOF 2017-10-24 19:33:36.847~2017-10-24 19:34:36.858(60): max=1,min=0,avg=0,total=18,req=256,msg=InvokeChain]
[2017-10-24 19:34:37:362] 127 D com.creditease.agent.feature.logagent.RuleFilterFactory$FilterAndRuleChain.doProcess(367) datalog >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> []
[2017-10-24 19:34:37:362] 127 D com.creditease.agent.feature.logagent.TailFileTaskJob.work(75) serverlogs is emptry!!!
[2017-10-24 19:34:37:362] 127 E com.creditease.agent.feature.logagent.TailFileTaskJob.work(84) finally invoked...

MSCP重启后无法正确使用system.cache的系统变量

系统：centos6.7

安装包：oneshotstart_linux

日志：http://pan.baidu.com/s/1skPciwH

com.creditease.uav.apphub.rest.GUIService$AppInfoCacheThread.run(686) 初始化缓存处理 app 配置加载 :http://192.168.1.103:8080/apphub/uavapp_baseclassmgt/config.properties
[2017-09-17 11:55:22:290] 61 E com.creditease.uav.apphub.rest.GUIService$AppInfoCacheThread.run(706) AppInfoCacheThread run :Server returned HTTP response code: 403 for URL: http://192.168.1.103:8080/apphub/uavapp_baseclassmgt/config.propertiesjava.io.IOException: Server returned HTTP response code: 403 for URL: http://192.168.1.103:8080/apphub/uavapp_baseclassmgt/config.properties
at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1876)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)
at com.creditease.agent.helpers.PropertiesHelper.downloadProperties(PropertiesHelper.java:129)
at com.creditease.uav.apphub.rest.GUIService$AppInfoCacheThread.run(GUIService.java:687)

agent's bulid remove threadanalysis's redundant jars，only reserve threadanalysis client jar

Tomcat 7.0.0~7.0.23 has no getStartStopExecutor method which leads the failure of MOF App installation

java.lang.NoSuchMethodError: org.apache.catalina.Host.getStartStopExecutor()Ljava/util/concurrent/ExecutorService;
at com.creditease.tomcat.plus.interceptor.TomcatPlusIT.onDeployUAVApp(TomcatPlusIT.java:473)
at org.apache.catalina.startup.HostConfig.deployDirectories(HostConfig.java:981)
at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:472)
at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1322)

UAVStack Attachment

SpringBootTomcatPlusIT onAppStop NPE.

when springboot stops, sometimes there is an NPE. however, it doesn't matter. we fix this for better stopping.

uav全体：
您好，有以下三点需求，麻烦考虑加入到uavstack中，完善监控体系：
1.目前在日志模块，无法通过以集群为单位，希望查询整个集群中所涉及的查询内容出现在哪几台实例上。这样可以更快速的定位问题，而不是仅仅通过每一个实例去查询。
2.调用链路的提议：希望把traceId存放到业务日志中，这样就能从日志到调用链路，直接定位问题，整个一套的全维关联。通过关联traceID，能够准确定位调用链路，定位服务实例，定位集群、机器的问题。
3.当定位到问题以后，能不能及时对发生异常的服务进行降级，或者在控制台进行实时降级，优化性能等操作。
希望考虑以上三点需求，辛苦！