2.1商城图片展示：
商城App：https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/samples/mall-shopping-03.png
商城小程序：https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/samples/shopping-app-04.png
商城移动端：https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/samples/shopping-app-05.png
商城PC端：https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/samples/shopping-app-06.png
商城后台管理：https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/samples/shopping-app-07.png
2.2compute-mr
1、mr-website-analyse:1.1主要做的事情：hadoopHA集群搭建部署；mapreduce基础掌握；使用oozie进行任务调度；使用hive保存数据到hdfs，以及从hdfs导出到mysql；使用hbase结合mapreduce处理业务，如用户行为分析；使用flume,nginx模拟收集日志，从javasdk端和js网站端收集数据等;1.2主要模块用户基本信息分析浏览器分析地域分析浏览深度分析搜索引擎分析事件分析订单分析2、mr-website-sdk2.1java服务端sdk采集2.2JS前端页面的数据模拟采集3、mr-website-view3.1数据可视化显示3.2主要使用highcharts，html，css,js显示mr-website-analyse数据处理的统计数据，存在mysqlhttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/mr/2791587557292_.pic.jpg
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/mr/2801587557292_.pic.jpg
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/mr/2811587557292_.pic.jpg
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/mr/2821587557292_.pic.jpg
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/mr/2831587557293_.pic.jpg
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/mr/2841587557293_.pic.jpg
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/mr/2851587557293_.pic.jpg
2.3compute-realtime:
1、compute-realtime-spark:1.1主要做的事情：基于Javee平台展示的Spark实时数据分析平台hadoopHA集群搭建部署；基于zookeeper的kafkaHA集群搭建部署；HA:本地搭建时共5个节点,2个namenode,3个datanode；sparkcore,sparksql,sparkstreaming基础掌握；kafka实时模拟生成数据并使用sparkstreaming实时处理来自kafka的数据；实时处理分析结果保存到mysql,由highcharts动态刷新；highcharts实时展示统计分析结果，以及sparksql算子执行结果；1.2主要模块广告点击流量分析广告点击趋势分析各省份top3热门广告分析各区域top3热门商品统计页面单跳转化率用户访问session分析Top10热门品类分析Top10用户session分析2、compute-realtime-view2.1数据可视化显示，定时模拟kafka消息队列的数据2.2主要使用highcharts，html，css,js显示compute-realtime-spark数据处理的统计数据，存在mysqlhttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/spark/2871587557435_.pic.jpg
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/spark/2881587557459_.pic.jpg
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/spark/2891587557479_.pic.jpg
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/spark/2901587557498_.pic.jpg
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/spark/2911587557535_.pic.jpg
3、数据来源商城前台：mall-shopping-app:商城Appmall-shopping-app-service:商城App服务mall-shopping-wc:商城小程序mall-shopping-mobile:商城前台mall-shopping-pc:商城pc端mall-shopping-pc-service:商城pc端服务mall-shopping-service:商城前台服务（小程序和前台接入此接口）商城后台：mall-admin-web:商城后台mall-admin-service:商城后台服务https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/microservice.pnghttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/system-api-gateway01.pnghttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/system-api-gateway02.pnghttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/system-apm.png4、数据收集log-collect-server:服务端日志收集系统log-collect-client:支持各app集成的客户端SDK，负责收集app客户端数据；data-import-export:基于DataX实现数据集成(导入导出)data-spider:爬虫平台支持可配置的爬取公网数据的任务开发；https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/Prometheus.pnghttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/apollo.pnghttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/log-collect.png5、数据存储分布式文件系统：hdfs分布式数据库：hbase、mongodb、elasticsearch分布式内存存储系统：redis6、数据计算compute-mr（离线计算）:Hive、MRcompute-realtime（流计算）:storm、flinkmulti-dimension-analysis（多维度分析）:kylin,spark7、数据开发task-schedular:任务调度task-ops:任务运维https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/system-deploy.pnghttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/system-deploy02.pnghttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/system-devops.png8、数据产品data-face:数据可视化data-insight:用户画像分析9、数据应用system-recommender:推荐system-ad:广告system-search:搜索system-anti-cheating:反作弊system-report-analysis:报表分析system-elk:ELK日志系统，实现日志搜索平台https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/system-elk.pnghttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/system-elk（2）.pngsystem-apm:skywalking监控平台system-deploy:k8s，scala，playframework，docker打包平台。job-schedule:任务提交平台10、启动配置教程10.1启动前，打包dubbo-servie项目，进入dubbo-service目录，执行mvncleanpackage-DskipTests=TRUE打包，然后执行mvninstall.
10.2启动dubbo-service项目，配置tomcat端口为8091
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/61.png
10.3启动商城项目的多个子系统
后台：访问https://localhost:8090
10.3.1、前端：启动mall-admin-web项目，进入项目目录，执行npminstall，然后执行npmrundev；
10.3.2、后端：启动mall-admin-service/mall-admin-search项目，配置tomcat端口为8092，接着启动mall-manage-service项目，tomcat端口配置为8093；
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/62.png
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/63.png
前台：小程序手机预览，移动端访问：https://localhost:6255
10.3.3、小程序和移动端
10.3.3.1、前端：商城小程序，启动mall-shopping-wc项目，安装微信开发者工具，配置开发者key和secret，使用微信开发者工具导入即可，然后点击编译，可以手机预览使用。
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/66.png
10.3.3.2、前端：商城移动端，启动mall-shopping-mobile，进入项目目录，执行npminstall和npmrundev；
10.3.3.3、后端：小程序和移动端用的是同一个后台服务，启动mall-shopping-service项目，进入项目目录，配置tomcat端口8094
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/64.png
10.3.4、商城PC端访问https://localhost:8099
10.3.4.1、前端：启动mall-shopping-pc项目，进入项目目录，执行npminstall和npmrundev；
10.3.4.2、后端：启动mall-shopping-pc-service项目，配置tomcat端口为8095；
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/65.png
11开发计划
https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/%E5%BC%80%E5%8F%91%E8%AE%A1%E5%88%92v1.0.png
12架构1.0
#1、数据平台架构https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/1571898118926.png#2、电商https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/%E7%94%B5%E5%95%86.png#3、微服务https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/microservice.png#4、容器化部署system-deployhttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/system-deploy.pnghttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/system-deploy02.png#5、自动化运维平台system-devopshttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/system-devops.png#6、使用Kong作为调用中心网关入口system-api-gatewayhttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/system-api-gateway01.pnghttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/system-api-gateway02.png#7、日志中心system-elkhttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/system-elk.png#8、告警平台system-alarm-platform8.1监控系统https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/Prometheus.png8.2数据采集https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/log-collect.png8.3数据展示https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/system-elk%20%282%29.png#9、监控中心system-apmhttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/system-apm.png#10、使用Apollo作为配置中心system-confighttps://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/apollo.png#11、数据平台开发规划https://my-macro-oss.oss-cn-shenzhen.aliyuncs.com/mall/images/design/%E5%BC%80%E5%8F%91%E8%AE%A1%E5%88%92v1.0.png
评论