最近做項(xiàng)目，用到goreplay來(lái)做流量回放，什么是goreplay？

GoReplay is an open-source network monitoring tool which can record your live traffic, and use it for shadowing, load testing, monitoring and detailed analysis.

本質(zhì)上就是通過(guò)監(jiān)控網(wǎng)絡(luò)，錄制http請(qǐng)求信息（對(duì)應(yīng)用無(wú)入侵），然后再把請(qǐng)求重新播放出來(lái)。

這是官方給出來(lái)運(yùn)行原理圖。

關(guān)于goreplay的使用方式，命令用法官方文檔給的很全面了，不作贅述，本篇文章關(guān)注的是除雜（過(guò)濾）。官方本來(lái)是支持過(guò)濾filtering的，但過(guò)濾的范圍有限，目前只有Allow?url regexp,Disallow url regexp,Filter based on regexp of header,Filter based on HTTP method，也就是對(duì)url,header,method三個(gè)方向作了過(guò)濾，我的需求是對(duì)body過(guò)濾，不包括在范圍內(nèi)（也有可能我沒(méi)找到對(duì)應(yīng)文檔）

官方找不到對(duì)應(yīng)辦法，只能“曲線救國(guó)”了，因?yàn)間oreplay錄制的內(nèi)容是文本性質(zhì)，所以可以對(duì)錄制內(nèi)容下手，把自己認(rèn)定的雜質(zhì)除掉，然后再播放，這樣就達(dá)到效果了。

錄制：

我是在windows下demo的，所以下載goreplay的winodwst版本【https://github.com/buger/goreplay/releases/download/v1.3.2/gor-1.3.2_windows.zip】，同時(shí)還需要安裝WinPcap配合【https://www.winpcap.org/install/bin/WinPcap_4_1_3.exe】，這樣就可以通過(guò)命令進(jìn)行錄制了：

gor?--input-raw?:5000?--output-file?request.gor

被錄制的服務(wù)是一個(gè)api，實(shí)現(xiàn)如下

[HttpPost("/order")] public IActionResult Post([FromBody] Order order) {_logger.LogInformation(System.Text.Json.JsonSerializer.Serialize(order));order.Status = 200;return new JsonResult(order); }public class Order {public string Code { get; set; }public?decimal?Amount?{?get;?set;?}public int Status { get; set; } }

gorreplay錄制的內(nèi)容格式如下：

1 c9051388c0a8000437c39d7f 1629555358511143000 0 POST /pay HTTP/1.1 Content-Type: application/json User-Agent: PostmanRuntime/7.28.3 Accept: */* Postman-Token: 3a49aba0-2e9b-4f1d-8fc8-01fb8b15d620 Host: 192.168.0.7:5000 Accept-Encoding: gzip, deflate, br Connection: keep-alive Content-Length: 92{"code":"3a13abfe-d9cb-4e11-ba90-738e93d2cb07","amount":908.59,"status":552 } ???????????? 1 c9051388c0a8000437c39d7f 1629555358813757000 0 POST /pay HTTP/1.1 Content-Type: application/json User-Agent: PostmanRuntime/7.28.3 Accept: */* Postman-Token: 3a49aba0-2e9b-4f1d-8fc8-01fb8b15d620 Host: 192.168.0.7:5000 Accept-Encoding: gzip, deflate, br Connection: keep-alive Content-Length: 92{"code":"3a13abfe-d9cb-4e11-ba90-738e93d2cb07","amount":908.59,"status":552 } ????????????

除雜

文中的json就是我請(qǐng)求的body，就要依據(jù)這個(gè)json中的一些數(shù)據(jù)來(lái)除雜，所以就得寫(xiě)段代碼解決這個(gè)事情。

其實(shí)原理很簡(jiǎn)單，因?yàn)槲抑牢艺?qǐng)求的都是json，所以就是從錄制的文件中，按段切割，很明細(xì)就是三只猴子????????????為分割點(diǎn)，把內(nèi)容中的json查詢出來(lái)，然后運(yùn)用上規(guī)則引擎達(dá)到過(guò)濾作用，把符合條件的數(shù)據(jù)留下，不符合條件的數(shù)據(jù)就除雜，最后保存成一個(gè)新文件，供流量回放時(shí)使用。

規(guī)則引擎

桂素偉，公眾號(hào)：桂跡一個(gè)簡(jiǎn)單的規(guī)則引擎例子

步驟確定了，下面是代碼：

using RulesEngine; using RulesEngine.Models; using RulesEngine.Extensions; using System.IO; using System.Text; using System.Text.RegularExpressions; using Newtonsoft.Json.Converters; using Newtonsoft.Json; using System.Dynamic;var path = @"C:\MyFile\Source\Repos\Asp.NetCoreExperiment\Asp.NetCoreExperiment\GoReplay\GoReplayDemo01\request_0.gor"; var expression = "input1.amount >= 900.00"; await ImpurityRemoval(path, expression);/// <summary> /// 除雜方法，會(huì)重新生成一個(gè)帶有日期時(shí)間的新.gor文件 /// </summary> static async Task ImpurityRemoval(string path, string expression) {using var readFile = new StreamReader(path, Encoding.UTF8);using var writeFile = new StreamWriter(@$"{path.Replace(Path.GetFileName(path), Path.GetFileNameWithoutExtension(path) + "_" + DateTime.Now.ToString("yyyyMMddHHmmss") + Path.GetExtension(path))}", true, Encoding.UTF8);var split = "????????????";string? line;var request = new StringBuilder();while ((line = await readFile.ReadLineAsync()) != null){if (line != split){request.Append(line + "\n");}else{request.Append(line + "\n");var list = GetJson(request.ToString());foreach (var item in list){var converter = new ExpandoObjectConverter();var entity = JsonConvert.DeserializeObject<ExpandoObject>(item, converter);if (await Filter(entity, expression)){await writeFile.WriteAsync(request.ToString());}}request.Clear();}} } /// <summary> /// 獲取json，這里沒(méi)有完全測(cè)試 /// </summary> static List<string> GetJson(string jsonString) {var pattern = @"\{(.|\s)*\}";var list = new List<string>();var matches = Regex.Matches(jsonString, pattern, RegexOptions.IgnoreCase);foreach (Match m in matches){list.Add(m.Value);}return list; } /// <summary> /// 用規(guī)則引擎匹配過(guò)濾規(guī)則 /// </summary> static async Task<bool> Filter(dynamic? entity, string expression) {var workRules = new WorkflowRules();workRules.WorkflowName = "ImpurityRemoval";workRules.Rules = new List<Rule>{new Rule{RuleName="ImpurityRemoval01",SuccessEvent= "10",RuleExpressionType= RuleExpressionType.LambdaExpression,Expression= expression, }};var rulesEngine = new RulesEngine.RulesEngine(new WorkflowRules[] { workRules });List<RuleResultTree> resultList = await rulesEngine.ExecuteAllRulesAsync("ImpurityRemoval", entity);var result = false;resultList.OnSuccess((eventName) =>{result = true;});return result; }

回放

gor?--input-file=request_0_20210821234723.gor?--output-http="http://localhost:5000"

注意事項(xiàng)：

在錄制的時(shí)候本機(jī)請(qǐng)求不進(jìn)行錄制，需要外部訪問(wèn)api

在除雜過(guò)程中，重新生成gor文件時(shí)，換行一定要UNIX(LF)，不要是Windows(CRLF)，說(shuō)人話就是生成文件的換行用\n，不要\r\n，否則回放時(shí)goreplay不起作用

總結(jié)

以上是生活随笔為你收集整理的Goreplay来做流量回放的全部?jī)?nèi)容，希望文章能夠幫你解決所遇到的問(wèn)題。

如果覺(jué)得生活随笔網(wǎng)站內(nèi)容還不錯(cuò)，歡迎將生活随笔推薦給好友。