|
|
|
RocketMQ 开发手册3.2.4.pdf 百度云盘下载
目录
1 前言 ................................ ................................ ................................ ................................ ................................ .................... 1
2 产品发展历史 产品发展历史 产品发展历史 ................................ ................................ ................................ ................................ ................................ .... 1
3 专业术语 专业术语 ................................ ................................ ................................ ................................ ................................ ........... 2
4 消息中间件需要解决哪些问题？ 消息中间件需要解决哪些问题？ 消息中间件需要解决哪些问题？ 消息中间件需要解决哪些问题？ 消息中间件需要解决哪些问题？ 消息中间件需要解决哪些问题？ ................................ ................................ ................................ ................................ ... 4
4.1 Publish/SubscribePublish/Subscribe Publish/SubscribePublish/SubscribePublish/SubscribePublish/Subscribe Publish/Subscribe Publish/Subscribe Publish/Subscribe ................................ ................................ ................................ ................................ ............. 4
4.2 Message Priority Message Priority Message Priority Message PriorityMessage Priority Message Priority Message Priority Message Priority ................................ ................................ ................................ ................................ ............... 4
4.3 Message Order Message Order Message Order Message Order Message Order ................................ ................................ ................................ ................................ ................. 5
4.4 Message Filter Message Filter Message Filter Message Filter Message FilterMessage Filter ................................ ................................ ................................ ................................ ................... 5
4.5 Message Persistence Message Persistence Message Persistence Message PersistenceMessage Persistence Message Persistence Message PersistenceMessage PersistenceMessage PersistenceMessage Persistence ................................ ................................ ................................ ................................ ........ 5
4.6 Message Reliablity Message Reliablity Message Reliablity Message Reliablity Message Reliablity Message Reliablity Message ReliablityMessage Reliablity ................................ ................................ ................................ ................................ ............ 6
4.7 Low Low Low Latency Messaging Latency MessagingLatency MessagingLatency MessagingLatency MessagingLatency Messaging Latency MessagingLatency Messaging Latency Messaging ................................ ................................ ................................ ................................ ... 6
4.8 At least Once At least OnceAt least OnceAt least Once At least OnceAt least Once ................................ ................................ ................................ ................................ ..................... 7
4.9 Exactly Only Once Exactly Only Once Exactly Only OnceExactly Only Once Exactly Only OnceExactly Only Once Exactly Only OnceExactly Only Once ................................ ................................ ................................ ................................ ............. 7
4.10 BrokerBroker Broker 的 BufferBuffer Buffer 满了怎么办？ 满了怎么办？ 满了怎么办？ 满了怎么办？ ................................ ................................ ................................ ...................... 7
4.11 回溯消费 回溯消费 ................................ ................................ ................................ ................................ ........................... 8
4.12 消息堆积 消息堆积 ................................ ................................ ................................ ................................ ........................... 8
4.13 分布式事务 分布式事务 ................................ ................................ ................................ ................................ ....................... 9
4.14 定时消息 定时消息 ................................ ................................ ................................ ................................ ........................... 9
4.15 消息重试 消息重试 ................................ ................................ ................................ ................................ ........................... 9
5 RocketMQ OverviewRocketMQ OverviewRocketMQ OverviewRocketMQ OverviewRocketMQ OverviewRocketMQ OverviewRocketMQ OverviewRocketMQ OverviewRocketMQ OverviewRocketMQ OverviewRocketMQ OverviewRocketMQ OverviewRocketMQ OverviewRocketMQ OverviewRocketMQ OverviewRocketMQ OverviewRocketMQ Overview ................................ ................................ ................................ ................................ ..................... 10
5.1 RocketMQ RocketMQ RocketMQRocketMQRocketMQ 是什么？ 是什么？ ................................ ................................ ................................ ................................ ....... 10
5.2 RocketMQ RocketMQ RocketMQRocketMQRocketMQ 物理部署结构 物理部署结构 物理部署结构 ................................ ................................ ................................ ............................... 11
5.3 RocketMQ RocketMQ RocketMQRocketMQRocketMQ 逻辑部署结构 逻辑部署结构 逻辑部署结构 ................................ ................................ ................................ ............................... 12
6 RocketMQ RocketMQ RocketMQRocketMQRocketMQ 存储特点 存储特点 ................................ ................................ ................................ ................................ ....................... 13
6.16.1 零拷贝原理 零拷贝原理 ................................ ................................ ................................ ................................ ...................... 13
6.26.2 文件系统 文件系统 ................................ ................................ ................................ ................................ .......................... 14
6.36.3 数据存储结构 数据存储结构 数据存储结构 ................................ ................................ ................................ ................................ .................. 14
6.46.4 存储目录结构 存储目录结构 存储目录结构 ................................ ................................ ................................ ................................ .................. 15
6.56.5 数据可靠性 数据可靠性 ................................ ................................ ................................ ................................ ...................... 16
7 RocketMQ RocketMQ RocketMQRocketMQRocketMQ 关键特性 关键特性 ................................ ................................ ................................ ................................ ....................... 16
7.17.1 单机支持 单机支持 1万以上持久化队列 万以上持久化队列 万以上持久化队列 万以上持久化队列 万以上持久化队列 ................................ ................................ ................................ ....................... 16
7.27.2 刷盘策略 刷盘策略 ................................ ................................ ................................ ................................ .......................... 18
7.2.17.2.1 7.2.1 异步刷盘 异步刷盘 ................................ ................................ ................................ ................................ .................. 18
7.2.27.2.2 7.2.2 同步刷盘 同步刷盘 ................................ ................................ ................................ ................................ .................. 19
7.37.3 消息查询 消息查询 ................................ ................................ ................................ ................................ ......................... 20
7.3.17.3.1 按照 Message IdMessage Id Message Id Message Id查询消息 查询消息 查询消息 ................................ ................................ ................................ .................... 20
7.3.27.3.2 7.3.2 按照 Message KeyMessage Key Message Key Message KeyMessage Key查询消息 查询消息 查询消息 ................................ ................................ ................................ ................. 20
7.47.4 服务器消息过滤 服务器消息过滤 服务器消息过滤 ................................ ................................ ................................ ................................ .............. 21
7.57.5 长轮询 长轮询 PullPull Pull ................................ ................................ ................................ ................................ ....................... 22
7.67.6 顺序消息 顺序消息 ................................ ................................ ................................ ................................ .......................... 22
7.6.17.6.1 7.6.1 顺序消息原理 顺序消息原理 顺序消息原理 ................................ ................................ ................................ ................................ .......... 22
7.6.27.6.2 7.6.2 顺序消息缺陷 顺序消息缺陷 顺序消息缺陷 ................................ ................................ ................................ ................................ .......... 22
7.77.7 事务消息 事务消息 ................................ ................................ ................................ ................................ ......................... 23
7.87.8 发送消息负载均衡 发送消息负载均衡 发送消息负载均衡 发送消息负载均衡 ................................ ................................ ................................ ................................ ......... 23
7.97.9 订阅消息负载均衡 订阅消息负载均衡 订阅消息负载均衡 订阅消息负载均衡 ................................ ................................ ................................ ................................ ......... 24
7.107.10 单队列并行消费 单队列并行消费 单队列并行消费 ................................ ................................ ................................ ................................ ............. 25
7.117.11 发送定时消息 发送定时消息 发送定时消息 ................................ ................................ ................................ ................................ ................. 25
7.127.12 7.12 消息费失败，定时重试 消息费失败，定时重试 消息费失败，定时重试 消息费失败，定时重试 消息费失败，定时重试 ................................ ................................ ................................ ............................. 25
7.137.13 HA ，同步双写 ，同步双写 ，同步双写 /异步复制 异步复制 ................................ ................................ ................................ ............................... 25
7.147.14 单个 JVMJVMJVM进程也能利用机器超大内存 进程也能利用机器超大内存 进程也能利用机器超大内存 进程也能利用机器超大内存 进程也能利用机器超大内存 进程也能利用机器超大内存 ................................ ................................ ................................ ........ 26
7.157.15 消息堆积问题解决办法 消息堆积问题解决办法 消息堆积问题解决办法 消息堆积问题解决办法 消息堆积问题解决办法 ................................ ................................ ................................ ................................ . 27
8 RocketMQ RocketMQ RocketMQRocketMQRocketMQ 消息过滤 消息过滤 ................................ ................................ ................................ ................................ ...................... 27
8.18.1 简单消息过滤 简单消息过滤 简单消息过滤 ................................ ................................ ................................ ................................ ................. 27
8.28.2 高级消息过滤 高级消息过滤 高级消息过滤 ................................ ................................ ................................ ................................ ................. 28
9 RocketMQ RocketMQ RocketMQRocketMQRocketMQ 通信组件 通信组件 ................................ ................................ ................................ ................................ ...................... 29
9.1 网络协议 网络协议 ................................ ................................ ................................ ................................ ......................... 29
9.2 心跳处理 心跳处理 ................................ ................................ ................................ ................................ ......................... 30
9.3 连接复用 连接复用 ................................ ................................ ................................ ................................ .......................... 31
9.4 超时连接 超时连接 ................................ ................................ ................................ ................................ .......................... 31
10 RocketMQ RocketMQ RocketMQRocketMQRocketMQ 服务发现（ 服务发现（ 服务发现（ Name ServerName ServerName Server Name Server Name Server Name Server） ................................ ................................ ................................ ......................... 31
11 客户端使用指南 客户端使用指南 客户端使用指南 ................................ ................................ ................................ ................................ ...................... 31
11.1 11.1 客户端如何寻址 客户端如何寻址 客户端如何寻址 ................................ ................................ ................................ ................................ .............. 31
11.2 11.2 自定义客户端行为 自定义客户端行为 自定义客户端行为 自定义客户端行为 ................................ ................................ ................................ ................................ ......... 32
11.2.1 11.2.1 11.2.1 客户端 客户端 API 形式 ................................ ................................ ................................ ................................ ..... 32
11.2.2 11.2.2 11.2.2 客户端的公共配置 客户端的公共配置 客户端的公共配置 客户端的公共配置 ................................ ................................ ................................ ................................ . 32
11.2.3 11.2.3 11.2.3 ProducerProducer ProducerProducer 配置 ................................ ................................ ................................ ................................ ......... 33
11.2.4 11.2.4 11.2.4 PushConsumerPushConsumer PushConsumerPushConsumerPushConsumer PushConsumer 配置 ................................ ................................ ................................ ............................... 33
11.2.5 11.2.5 PullConsumerPullConsumer PullConsumer PullConsumer PullConsumer 配置 ................................ ................................ ................................ ................................ . 34
11.3 11.3 Message Message Message数据结构 数据结构 ................................ ................................ ................................ ................................ ......... 35
11.3.1 11.3.1 11.3.1 针对 ProducerProducer ProducerProducer ................................ ................................ ................................ ................................ ......... 35
11.3.2 11.3.2 11.3.2 针对 ConsumerConsumerConsumerConsumer Consumer ................................ ................................ ................................ ................................ ....... 35
12 BrokerBrokerBrokerBrokerBrokerBroker使用指南 使用指南 ................................ ................................ ................................ ................................ ................... 35
12.1 12.1 BrokerBroker Broker 配置参数 配置参数 ................................ ................................ ................................ ................................ ............. 35
12.2 12.212.2 BrokerBroker Broker 集群搭建 集群搭建 ................................ ................................ ................................ ................................ ............. 37
12.3 12.3 BrokerBroker Broker 重启对客户端的影响 重启对客户端的影响 重启对客户端的影响 重启对客户端的影响 重启对客户端的影响 ................................ ................................ ................................ ......................... 40
13 ProducerProducer ProducerProducer 最佳实践 最佳实践 ................................ ................................ ................................ ................................ ......................... 40
13.1 13.1 发送消息注意事项 发送消息注意事项 发送消息注意事项 发送消息注意事项 ................................ ................................ ................................ ................................ ......... 40
13.2 13.2 消息发送失败如何处理 消息发送失败如何处理 消息发送失败如何处理 消息发送失败如何处理 消息发送失败如何处理 ................................ ................................ ................................ ................................ .. 41
13.3 13.3 选择 onewayonewayoneway oneway 形式发送 形式发送 ................................ ................................ ................................ ................................ .. 42
13.4 13.4 发送顺序消息注意事项 发送顺序消息注意事项 发送顺序消息注意事项 发送顺序消息注意事项 发送顺序消息注意事项 ................................ ................................ ................................ ................................ . 42
14 ConsumerConsumer Consumer 最佳实践 最佳实践 最佳实践 ................................ ................................ ................................ ................................ ....................... 42
14.1 14.1 消费过程要做到幂等（即端去重） 消费过程要做到幂等（即端去重） 消费过程要做到幂等（即端去重） 消费过程要做到幂等（即端去重） 消费过程要做到幂等（即端去重） 消费过程要做到幂等（即端去重） 消费过程要做到幂等（即端去重） 消费过程要做到幂等（即端去重） ................................ ................................ ................................ ..... 42
14.2 14.2 消费失败处理方式 消费失败处理方式 消费失败处理方式 消费失败处理方式 ................................ ................................ ................................ ................................ ......... 43
14.3 14.3 消费速度慢处理方式 消费速度慢处理方式 消费速度慢处理方式 消费速度慢处理方式 ................................ ................................ ................................ ................................ ..... 43
14.3.1 14.3.1 14.3.1 提高消费并行度 提高消费并行度 提高消费并行度 ................................ ................................ ................................ ................................ ..... 43
14.3.2 14.3.2 14.3.2 批量方式消费 批量方式消费 批量方式消费 ................................ ................................ ................................ ................................ ......... 44
14.3.3 14.3.3 14.3.3 跳过非重要消息 跳过非重要消息 跳过非重要消息 ................................ ................................ ................................ ................................ ..... 44
14.3.4 14.3.4 优化每条消息费过程 优化每条消息费过程 优化每条消息费过程 优化每条消息费过程 优化每条消息费过程 ................................ ................................ ................................ ......................... 45
14.4 14.4 消费打印日志 消费打印日志 消费打印日志 ................................ ................................ ................................ ................................ ................. 46
14.5 14.5 利用服务器消息过滤，避免多余的传输 利用服务器消息过滤，避免多余的传输 利用服务器消息过滤，避免多余的传输 利用服务器消息过滤，避免多余的传输 利用服务器消息过滤，避免多余的传输 利用服务器消息过滤，避免多余的传输 利用服务器消息过滤，避免多余的传输 利用服务器消息过滤，避免多余的传输 利用服务器消息过滤，避免多余的传输 ................................ ................................ ............................. 46
附录 A 参考文档、规范 参考文档、规范 参考文档、规范 参考文档、规范 ................................ ................................ ................................ ................................ ........................ 46
百度云盘私密分享链接：
链接：http://pan.baidu.com/s/1sl3szzZ
提取码，回复可见：
|
|
发表于 2016-9-26 11:01:05
收藏
转播
分享
淘帖
发表于 2016-9-26 13:55:48