Subject: Rare project developers
List archive
- From: Alexander Gall <>
- To: <>
- Cc: Vágó Tibor <>, Frédéric LOUI <>
- Subject: Re: [rare-dev] bf_fwd issues
- Date: Fri, 6 May 2022 16:01:20 +0200
On Fri, 6 May 2022 15:20:18 +0200, mc36 <> said:
> so here is the dump without the cumtime < 10...
> as you can see, the l2tp4 message takes 10x the label4, labroute4, etc
> messages summed up soo there must be something...
> any python experts here who can spot the issue with that particular one?
My first impression is that it probably has to do with the relatively
large data size of the tbl_nexthop table for l2tpv4, possibly made
worse by the presence of field annotations. The time appears to be
spent mostly in the _Annotation.__eq__, _verify_size_and_set and
_convert_to_bytearray functions. It could well be that this is an
inefficiency in client.py, i.e. it would need to be addressed by
Intel, eventually.
Just a shot from the hip, could be completely wrong :)
--
Alex
> thanks,
> cs
> ps: attaching the raw traces if someone have better tools than dot :)
>>>> import pstats
>>>> p=pstats.Stats("profiler.pstat")
>>>> p.print_stats()
> Fri May 6 14:59:01 2022 profiler.pstat
> 434215796 function calls (435427369 primitive calls) in 888.909
> seconds
> Random listing order was used
> ncalls tottime percall cumtime percall filename:lineno(function)
> 19840 0.503 0.000 849.600 0.043
> /home/mc36/rare/bfrt_python/rare/bf_rt_rare/proc_entry_from_cp.py:4(BfForwarder._processEntryFromControlPlane)
> 22546/22547 0.091 0.000 817.212 0.036
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1841(_Table.make_data)
> 22546/22547 0.768 0.000 817.121 0.036
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1390(_Data.__init__)
> 2655 0.110 0.000 813.848 0.307
> /home/mc36/rare/bfrt_python/rare/api/l2tp4.py:4(BfForwarder.writeL2tp4rules)
> 411095586 418.191 0.000 418.191 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:643(_Annotation.__eq__)
> 120278/120279 2.500 0.000 414.954 0.003
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1453(_verify_size_and_set)
> 139319/139320 188.561 0.001 400.037 0.003
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:112(_convert_to_bytearray)
> 22546 185.160 0.008 396.829 0.018
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1428(_check_for_dups)
> 19825 0.233 0.000 47.552 0.002
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1852(_Table.entry_add)
> 43285 0.126 0.000 38.578 0.001
> /usr/local/lib/python3.9/dist-packages/grpc/_common.py:77(_transform)
> 19840 0.207 0.000 29.843 0.002
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:370(_ReaderWriterInterface._write)
> 19840 0.114 0.000 29.346 0.001
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:539(_UnaryUnaryMultiCallable.__call__)
> 19840 0.176 0.000 29.181 0.001
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:522(_UnaryUnaryMultiCallable._blocking)
> 4508/4509 0.275 0.000 26.828 0.006
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1776(_GetParser._parse_entry_get_response)
> 21643 0.106 0.000 25.622 0.001
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:446(_start_unary_request)
> 21643 0.052 0.000 25.494 0.001
> /usr/local/lib/python3.9/dist-packages/grpc/_common.py:88(serialize)
> 2706/2707 0.559 0.000 24.550 0.009
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1694(_GetParser._parse_data)
> 19840 0.253 0.000 23.760 0.001
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:502(_UnaryUnaryMultiCallable._prepare)
> 19840 0.098 0.000 22.836 0.001
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1035(WriteRequest.SerializeToString)
> 751 0.113 0.000 22.424 0.030
> /home/mc36/rare/bfrt_python/rare/bf_ports/__init__.py:201(BfPorts.getIfs)
> 19840 0.099 0.000 21.111 0.001
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1049(WriteRequest.SerializePartialToString)
> 19840/264168 1.890 0.000 20.994 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1055(WriteRequest.InternalSerialize)
> 1096714 4.379 0.000 20.739 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:244(_TableInfo._data_field_metadata_get)
> 21643/62213 0.765 0.000 19.192 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/encoder.py:757(EncodeRepeatedField)
> 900/901 0.012 0.000 18.672 0.021
> /home/mc36/rare/bfrt_python/rare/bf_ports/__init__.py:107(BfPorts.entryGetDict)
> 1107334 9.689 0.000 16.510 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:211(_TableInfo._data_field_get)
> 150/151 0.058 0.000 15.473 0.102
> /home/mc36/rare/bfrt_python/rare/bf_ports/__init__.py:239(BfPorts.getIfCounters)
> 3072 0.072 0.000 15.358 0.005
> /home/mc36/rare/bfrt_python/rare/api/label4.py:4(BfForwarder.writeMplsRules)
> 19840 0.548 0.000 14.628 0.001
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:2500(_Table._entry_write_req_make)
> 25313 0.844 0.000 14.469 0.001
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:129(_handle_event)
> 21642 0.060 0.000 13.197 0.001
> /usr/local/lib/python3.9/dist-packages/grpc/_common.py:92(deserialize)
> 43286/142591 0.790 0.000 13.163 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/encoder.py:764(EncodeField)
> 5473 0.124 0.000 13.127 0.002
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:166(handle_event)
> 21642 0.126 0.000 13.074 0.001
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:755(FromString)
> 1803 0.017 0.000 12.304 0.007
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1080(ReadResponse.MergeFromString)
> 1803/88235 1.931 0.001 12.284 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1100(ReadResponse.InternalParse)
> 1804/7214 0.749 0.000 12.194 0.002
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/decoder.py:601(DecodeRepeatedField)
> 2856/13226 0.215 0.000 11.774 0.001
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/decoder.py:623(DecodeField)
> 2706 0.269 0.000 9.337 0.003
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1510(_Data.to_dict)
> 254243/465200 2.167 0.000 9.076 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1008(TargetDevice.ByteSize)
> 67306 1.193 0.000 9.062 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1525(_Data._get_val)
> 3071 0.046 0.000 8.909 0.003
> /home/mc36/rare/bfrt_python/rare/api/labroute4.py:4(BfForwarder.writeGlobRules4)
> 36108 0.176 0.000 7.562 0.000
> /usr/lib/python3.9/logging/__init__.py:1444(Logger.warning)
> 36108 0.204 0.000 7.346 0.000
> /usr/lib/python3.9/logging/__init__.py:1561(Logger._log)
> 21643/120948 0.384 0.000 7.231 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/encoder.py:307(FieldSize)
> 508496 1.988 0.000 7.205 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:777(WriteRequest.ListFields)
> 307838 1.100 0.000 7.100 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:349(_TableInfo.data_field_annotations_get)
> 2655 0.033 0.000 6.543 0.002
> /home/mc36/rare/bfrt_python/rare/api/nhop2port.py:4(BfForwarder.writeNhop2portRules)
> 21632 0.380 0.000 6.343 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:2556(_Table._set_table_data)
> 379666 1.222 0.000 5.768 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:658(TargetDevice.field_setter)
> 2655 0.035 0.000 5.722 0.002
> /home/mc36/rare/bfrt_python/rare/api/portvrf.py:3(BfForwarder.writeVrfRules)
> 184859 1.492 0.000 5.717 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/containers.py:368(RepeatedCompositeFieldContainer.add)
> 1803 0.059 0.000 5.544 0.003
> /home/mc36/rare/bfrt_python/rare/bf_ports/__init__.py:96(BfPorts.entryGet)
> 67395 1.291 0.000 5.409 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1651(_GetParser._parse_data_field)
> 1803 0.063 0.000 5.325 0.003
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:2012(_Table.entry_get)
> 240506 0.801 0.000 5.148 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:293(_TableInfo.data_field_type_get)
> 20741 0.552 0.000 5.124 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:2523(_Table._set_table_key)
> 187585 0.725 0.000 4.623 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:281(_TableInfo.data_field_size_get)
> 40570 0.438 0.000 4.487 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/encoder.py:299(RepeatedFieldSize)
> 36108 0.123 0.000 4.246 0.000
> /usr/lib/python3.9/logging/__init__.py:1587(Logger.handle)
> 187585 0.697 0.000 4.215 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:304(_TableInfo.data_field_repeated_get)
> 36108 0.194 0.000 4.080 0.000
> /usr/lib/python3.9/logging/__init__.py:1641(Logger.callHandlers)
> 267240 0.818 0.000 3.940 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:703(WriteRequest.getter)
> 72216 0.381 0.000 3.885 0.000
> /usr/lib/python3.9/logging/__init__.py:935(StreamHandler.handle)
> 155817 0.869 0.000 3.857 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:424(MakeSubMessageDefault)
> 52921 0.435 0.000 3.731 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:2571(_Table._set_table_data_single_field)
> 1803 0.032 0.000 3.527 0.002
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:381(_ReaderWriterInterface._read)
> 150 0.050 0.000 3.477 0.023
> /home/mc36/rare/bfrt_python/rare/bf_ports/__init__.py:260(BfPorts.getSubIfCounters)
> 284010 1.586 0.000 3.462 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:469(WriteRequest.init)
> 1544498 3.090 0.000 3.460 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:215(_data_field_get_helper)
> 1803 0.090 0.000 3.437 0.002
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:590(_UnaryStreamMultiCallable.__call__)
> 324575 1.913 0.000 3.348 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1022(DataTuple.__lt__)
> 544268 2.055 0.000 3.307 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/encoder.py:375(EncodeVarint)
> 282433 0.699 0.000 3.256 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/type_checkers.py:129(Uint32ValueChecker.CheckValue)
> 72216 0.348 0.000 3.054 0.000
> /usr/lib/python3.9/logging/__init__.py:1067(StreamHandler.emit)
> 530129 1.506 0.000 3.043 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:778(<listcomp>)
> 472003 1.885 0.000 3.035 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1390(_Listener.__init__)
> 21643 0.309 0.000 2.774 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:348(_cpy_target)
> 221125 0.618 0.000 2.644 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/encoder.py:462(EncodeField)
> 23448 0.083 0.000 2.626 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1834(_Table.make_key)
> 120279 0.400 0.000 2.543 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:315(_TableInfo.data_field_mandatory_get)
> 23448 0.450 0.000 2.543 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1186(_Key.__init__)
> 1803 0.022 0.000 2.542 0.001
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1035(ReadRequest.SerializeToString)
> 88235 1.092 0.000 2.487 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:469(ReadResponse.init)
> 36108 0.112 0.000 2.399 0.000
> /usr/lib/python3.9/logging/__init__.py:1546(Logger.makeRecord)
> 1803 0.024 0.000 2.338 0.001
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1049(ReadRequest.SerializePartialToString)
> 1803/11718 0.241 0.000 2.310 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1055(ReadRequest.InternalSerialize)
> 36108 0.802 0.000 2.286 0.000
> /usr/lib/python3.9/logging/__init__.py:278(LogRecord.__init__)
> 318540 0.550 0.000 2.092 0.000
> /usr/lib/python3.9/abc.py:96(__instancecheck__)
> 67395 0.380 0.000 1.980 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:172(_TableInfo.data_field_name_get)
> 230597 1.304 0.000 1.731 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/decoder.py:117(DecodeVarint)
> 40097 0.394 0.000 1.646 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1215(_fix_size_verify_type)
> 19840/264168 1.240 0.000 1.627 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1134(WriteRequest.IsInitialized)
> 67395 1.311 0.000 1.600 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:181(_data_field_name_get_helper)
> 244332/340039 0.708 0.000 1.580 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1345(TargetDevice.Modified)
> 72216 0.155 0.000 1.546 0.000
> /usr/lib/python3.9/logging/__init__.py:912(StreamHandler.format)
> 992204 1.267 0.000 1.538 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:762(_IsPresent)
> 649150 1.436 0.000 1.436 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:998(DataTuple.__key)
> 72216 0.342 0.000 1.391 0.000
> /usr/lib/python3.9/logging/__init__.py:646(Formatter.format)
> 508499 0.910 0.000 1.282 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:649(MessageOptions.getter)
> 71033 0.533 0.000 1.244 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:60(to_bytes)
> 164606 0.874 0.000 1.157 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/decoder.py:169(ReadTag)
> 84326 0.415 0.000 1.145 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/decoder.py:238(DecodeField)
> 1803 0.085 0.000 1.092 0.001
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:2466(_Table._entry_read_req_make)
> 176731 0.738 0.000 1.062 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:649(TableEntry.getter)
> 88040 0.400 0.000 1.059 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1434(_OneofListener.Modified)
> 319033/361417 0.629 0.000 1.013 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1409(_Listener.Modified)
> 48358 0.410 0.000 0.992 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:146(_convert_to_presentation)
> 90009 0.390 0.000 0.960 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/encoder.py:722(EncodeField)
> 151 0.014 0.000 0.942 0.006
> /home/mc36/rare/bfrt_python/rare/bf_ports/__init__.py:221(BfPorts.getSubIfs)
> 52921 0.106 0.000 0.940 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:270(_TableInfo.data_field_id_get)
> 131618 0.669 0.000 0.931 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:808(TableEntry.HasField)
> 216872 0.645 0.000 0.926 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1360(Entity._UpdateOneofState)
> 108950 0.352 0.000 0.891 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:604(WriteRequest.getter)
> 72216 0.374 0.000 0.890 0.000
> /usr/lib/python3.9/logging/__init__.py:1056(StreamHandler.flush)
> 2706 0.019 0.000 0.853 0.000
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:362(_Rendezvous.__next__)
> 282434 0.485 0.000 0.850 0.000
> /usr/lib/python3.9/abc.py:100(__subclasscheck__)
> 120342 0.616 0.000 0.846 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:893(DataTuple.__init__)
> 2706 0.110 0.000 0.834 0.000
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:333(_Rendezvous._next)
> 992204 0.812 0.000 0.812 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:779(<lambda>)
> 88235/96803 0.469 0.000 0.809 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1345(ReadResponse.Modified)
> 21633 0.220 0.000 0.791 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:777(ReadRequest.ListFields)
> 46312 0.256 0.000 0.732 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:703(Entity.getter)
> 2707 0.149 0.000 0.731 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1620(_GetParser._parse_key)
> 88040 0.254 0.000 0.717 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1425(_OneofListener.__init__)
> 18029 0.153 0.000 0.692 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:658(ReadRequest.field_setter)
> 557889 0.630 0.000 0.630 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/containers.py:202(RepeatedCompositeFieldContainer.__getitem__)
> 1803 0.062 0.000 0.627 0.000
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:790(create)
> 219322 0.414 0.000 0.612 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/encoder.py:148(FieldSize)
> 49323 0.250 0.000 0.585 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/decoder.py:534(DecodeField)
> 69427 0.233 0.000 0.573 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:410(MakeRepeatedMessageDefault)
> 52921 0.160 0.000 0.552 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:673(DataField.setter)
> 78885 0.257 0.000 0.548 0.000
> /usr/lib/python3.9/threading.py:256(Condition.__enter__)
> 31021 0.201 0.000 0.543 0.000
> /usr/lib/python3.9/threading.py:374(Condition.notify_all)
> 530129 0.508 0.000 0.508 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/descriptor.py:138(Descriptor.GetOptions)
> 22547 0.312 0.000 0.498 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:359(_TableInfo.data_field_name_list_get)
> 36108 0.242 0.000 0.496 0.000
> /usr/lib/python3.9/logging/__init__.py:1510(Logger.findCaller)
> 36108 0.167 0.000 0.428 0.000
> /usr/lib/python3.9/posixpath.py:117(splitext)
> 72216 0.137 0.000 0.424 0.000
> /usr/lib/python3.9/logging/__init__.py:630(Formatter.formatMessage)
> 2399 0.075 0.000 0.421 0.000
> /usr/lib/python3.9/threading.py:280(Condition.wait)
> 21643 0.179 0.000 0.417 0.000
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:97(_RPCState.__init__)
> 144432 0.270 0.000 0.408 0.000
> /usr/lib/python3.9/logging/__init__.py:892(StreamHandler.acquire)
> 48358 0.301 0.000 0.406 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:70(bytes_to_int)
> 497376 0.404 0.000 0.404 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/encoder.py:82(_VarintSize)
> 78886 0.261 0.000 0.386 0.000
> /usr/lib/python3.9/threading.py:259(Condition.__exit__)
> 90009 0.241 0.000 0.377 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/encoder.py:268(FieldSize)
> 143356 0.256 0.000 0.369 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/containers.py:206(RepeatedCompositeFieldContainer.__len__)
> 11718 0.174 0.000 0.368 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:469(ReadRequest.init)
> 72216 0.142 0.000 0.366 0.000
> /usr/lib/python3.9/logging/__init__.py:624(Formatter.usesTime)
> 71033 0.231 0.000 0.361 0.000
> /usr/lib/python3.9/encodings/hex_codec.py:17(hex_decode)
> 144432 0.247 0.000 0.359 0.000
> /usr/lib/python3.9/logging/__init__.py:899(StreamHandler.release)
> 36108 0.184 0.000 0.353 0.000
> /usr/lib/python3.9/posixpath.py:140(basename)
> 69427 0.246 0.000 0.340 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/containers.py:350(RepeatedCompositeFieldContainer.__init__)
> 113459 0.211 0.000 0.309 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/type_checkers.py:101(TypeCheckerWithDefault.CheckValue)
> 31021 0.221 0.000 0.294 0.000
> /usr/lib/python3.9/threading.py:351(Condition.notify)
> 72216 0.144 0.000 0.287 0.000
> /usr/lib/python3.9/logging/__init__.py:428(PercentStyle.format)
> 40097 0.211 0.000 0.277 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1035(KeyTuple.__init__)
> 72216 0.260 0.000 0.260 0.000
> /usr/lib/python3.9/logging/__init__.py:354(LogRecord.getMessage)
> 254244 0.253 0.000 0.253 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1309(TargetDevice._SetListener)
> 19841 0.079 0.000 0.230 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1080(WriteResponse.MergeFromString)
> 72216 0.145 0.000 0.223 0.000
> /usr/lib/python3.9/logging/__init__.py:417(PercentStyle.usesTime)
> 10620 0.052 0.000 0.221 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:470(_TableInfo.data_field_annotation_add)
> 36108 0.143 0.000 0.206 0.000
> /usr/lib/python3.9/genericpath.py:121(_splitext)
> 13692 0.106 0.000 0.202 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:73(ipv4_to_bytes)
> 21643 0.153 0.000 0.202 0.000
> /usr/lib/python3.9/threading.py:228(Condition.__init__)
> 97817 0.199 0.000 0.199 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:57(is_python2)
> 86432 0.197 0.000 0.197 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1309(Entity._SetListener)
> 1806 0.028 0.000 0.190 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1256(_Key.to_dict)
> 10517 0.083 0.000 0.188 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/decoder.py:497(DecodeField)
> 1803/11718 0.146 0.000 0.182 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1134(ReadRequest.IsInitialized)
> 120278 0.177 0.000 0.177 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1462(check_exists)
> 9915/13520 0.075 0.000 0.175 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1345(ReadRequest.Modified)
> 1807 0.028 0.000 0.170 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:2407(_Table._set_flags)
> 5310 0.089 0.000 0.168 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:86(mac_to_bytes)
> 32579 0.094 0.000 0.159 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1172(KeyTuple.__lt__)
> 2108 0.047 0.000 0.158 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1304(_Key._get_val)
> 9922 0.069 0.000 0.145 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:604(ReadResponse.getter)
> 72216 0.143 0.000 0.143 0.000
> /usr/lib/python3.9/logging/__init__.py:425(PercentStyle._format)
> 21643 0.109 0.000 0.142 0.000
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:740(__new__)
> 99222 0.134 0.000 0.134 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1466(check_size)
> 19841/19842 0.054 0.000 0.134 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1100(WriteResponse.InternalParse)
> 924/925 0.019 0.000 0.133 0.000
> /usr/lib/python3.9/threading.py:1001(BfPorts.join)
> 10665 0.054 0.000 0.132 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/decoder.py:257(InnerDecode)
> 36108 0.079 0.000 0.119 0.000
> /usr/lib/python3.9/logging/__init__.py:156(<lambda>)
> 37033 0.087 0.000 0.118 0.000
> /usr/lib/python3.9/threading.py:1318(current_thread)
> 21791 0.062 0.000 0.117 0.000
> /usr/lib/python3.9/logging/__init__.py:1420(Logger.debug)
> 2775/2776 0.019 0.000 0.117 0.000
> /usr/lib/python3.9/threading.py:1039(BfPorts._wait_for_tstate_lock)
> 23448 0.087 0.000 0.111 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:464(_TableInfo.key_field_name_list_get)
> 36108 0.078 0.000 0.111 0.000
> /usr/lib/python3.9/logging/__init__.py:119(getLevelName)
> 108324 0.108 0.000 0.108 0.000
> /usr/lib/python3.9/logging/__init__.py:787(Logger.filter)
> 22912 0.069 0.000 0.104 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/encoder.py:391(EncodeSignedVarint)
> 36108 0.073 0.000 0.103 0.000
> /usr/lib/python3.9/posixpath.py:52(normcase)
> 36108 0.067 0.000 0.099 0.000
> /usr/lib/python3.9/posixpath.py:41(_get_sep)
> 57899 0.096 0.000 0.096 0.000
> /usr/lib/python3.9/logging/__init__.py:1685(Logger.isEnabledFor)
> 69427 0.094 0.000 0.094 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/containers.py:192(RepeatedCompositeFieldContainer.__init__)
> 601 0.010 0.000 0.081 0.000
> /usr/lib/python3.9/socket.py:713(SocketIO.write)
> 1804 0.026 0.000 0.073 0.000
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:434(_Rendezvous.__del__)
> 42205 0.069 0.000 0.069 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:404(_TableInfo.key_field_size_get)
> 65158 0.065 0.000 0.065 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1152(KeyTuple.__key)
> 1803 0.027 0.000 0.062 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/encoder.py:699(EncodeField)
> 42205 0.056 0.000 0.056 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:413(_TableInfo.key_field_type_get)
> 8382 0.037 0.000 0.054 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:488(_TableInfo.key_field_annotation_add)
> 42205 0.053 0.000 0.053 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:457(_TableInfo.key_field_annotations_get)
> 19840 0.052 0.000 0.052 0.000
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:458(_end_unary_response_blocking)
> 37088 0.051 0.000 0.051 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:396(_TableInfo.key_field_id_get)
> 42205 0.051 0.000 0.051 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:421(_TableInfo.key_field_match_type_get)
> 21643 0.049 0.000 0.049 0.000
> /usr/lib/python3.9/threading.py:82(RLock)
> 40097 0.048 0.000 0.048 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:437(_TableInfo.key_field_mandatory_get)
> 36108 0.046 0.000 0.046 0.000
> /usr/lib/python3.9/threading.py:1053(BfForwarder.name)
> 1851 0.022 0.000 0.045 0.000
> /usr/lib/python3.9/threading.py:1093(BfPorts.is_alive)
> 43287 0.043 0.000 0.043 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/message_listener.py:77(NullMessageListener.Modified)
> 3009 0.036 0.000 0.043 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:446(_TableInfo.key_field_name_get)
> 13692 0.040 0.000 0.040 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:77(<listcomp>)
> 27056 0.039 0.000 0.039 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:99(_TableInfo.id_get)
> 5310 0.038 0.000 0.038 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:90(<listcomp>)
> 19840 0.036 0.000 0.036 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:2718(_BfRtInfo.table_get)
> 10517 0.033 0.000 0.033 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/decoder.py:467(_ConvertToUnicode)
> 463 0.004 0.000 0.032 0.000
> /home/mc36/rare/bfrt_python/rare/bf_gbl_env/var_env.py:62(is_any_thread_alive)
> 20142 0.031 0.000 0.031 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:368(<listcomp>)
> 463 0.005 0.000 0.028 0.000
> /home/mc36/rare/bfrt_python/rare/bf_gbl_env/var_env.py:63(<listcomp>)
> 19829 0.027 0.000 0.027 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:148(_TableInfo.action_id_get)
> 1803 0.017 0.000 0.025 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/type_checkers.py:173(UnicodeValueChecker.CheckValue)
> 901 0.010 0.000 0.022 0.000
> /home/mc36/rare/bfrt_python/rare/bf_ports/__init__.py:99(<lambda>)
> 21643 0.022 0.000 0.022 0.000
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:75(_deadline)
> 22912 0.022 0.000 0.022 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/encoder.py:96(_SignedVarintSize)
> 21643 0.021 0.000 0.021 0.000
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:744(_InitialMetadataFlags.with_wait_for_ready)
> 21643 0.020 0.000 0.020 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/api_implementation.py:146(IsPythonDefaultSerializationDeterministic)
> 19002 0.020 0.000 0.020 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:638(_Annotation.__init__)
> 1804 0.020 0.000 0.020 0.000
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:252(_Rendezvous.__init__)
> 11 0.000 0.000 0.019 0.002
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1918(_Table.entry_del)
> 1807 0.012 0.000 0.018 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/encoder.py:675(EncodeField)
> 3670 0.013 0.000 0.013 0.000
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:164(_event_handler)
> 5409 0.012 0.000 0.012 0.000
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:810(<genexpr>)
> 4 0.000 0.000 0.007 0.002
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:1875(_Table.entry_mod)
> 2776 0.006 0.000 0.006 0.000
> /usr/lib/python3.9/threading.py:529(Event.is_set)
> 159 0.001 0.000 0.005 0.000
> /usr/lib/python3.9/socket.py:690(SocketIO.readinto)
> 1 0.000 0.000 0.004 0.004
> /home/mc36/rare/bfrt_python/rare/api/unlabel4.py:5(BfForwarder.writeUnMplsRules)
> 1803 0.004 0.000 0.004 0.000
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:359(_Rendezvous.__iter__)
> 1807 0.004 0.000 0.004 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/encoder.py:203(FieldSize)
> 1 0.000 0.000 0.003 0.003
> /home/mc36/rare/bfrt_python/rare/api/cpulabel.py:4(BfForwarder.writeCpuMplsRules)
> 302 0.002 0.000 0.003 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/info_parse.py:161(_TableInfo.action_name_get)
> 235 0.001 0.000 0.002 0.000
> /usr/lib/python3.9/enum.py:745(StatusCode.__hash__)
> 601 0.002 0.000 0.002 0.000
> /usr/lib/python3.9/socket.py:736(SocketIO.writable)
> 159 0.001 0.000 0.002 0.000
> /usr/lib/python3.9/codecs.py:319(IncrementalDecoder.decode)
> 1 0.000 0.000 0.002 0.002
> /home/mc36/rare/bfrt_python/rare/api/myaddr4.py:4(BfForwarder.writeMyaddrRules4)
> 1 0.000 0.000 0.001 0.001
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:325(BfruntimeReadWriteRpcException.__init__)
> 2/463 0.000 0.000 0.000 0.000
> /home/mc36/rare/bfrt_python/bf_forwarder.py:170(<listcomp>)
> 1 0.000 0.000 0.000 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:282(_BfruntimeErrorIterator.__init__)
> 159 0.000 0.000 0.000 0.000
> /usr/lib/python3.9/socket.py:729(SocketIO.readable)
> 2 0.000 0.000 0.000 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/message.py:178(Status.ParseFromString)
> 2 0.000 0.000 0.000 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:311(_BfruntimeErrorIterator.__next__)
> 1 0.000 0.000 0.000 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/well_known_types.py:80(Any.Unpack)
> 3 0.000 0.000 0.000 0.000
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:398(_Rendezvous.code)
> 1 0.000 0.000 0.000 0.000
> /home/mc36/rare/bfrt_python/rare/bf_rt_rare/proc_entry_from_cp.py:90(_formatErrMessage)
> 2 0.000 0.000 0.000 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/python_message.py:1290(Status._Clear)
> 1 0.000 0.000 0.000 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/well_known_types.py:93(Any.Is)
> 2 0.000 0.000 0.000 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/decoder.py:140(DecodeVarint)
> 1 0.000 0.000 0.000 0.000
> /usr/local/lib/python3.9/dist-packages/grpc/_channel.py:392(_Rendezvous.trailing_metadata)
> 1 0.000 0.000 0.000 0.000
> /usr/local/lib/python3.9/dist-packages/google/protobuf/internal/well_known_types.py:88(Any.TypeName)
> 1 0.000 0.000 0.000 0.000 <string>:1(<lambda>)
> 1 0.000 0.000 0.000 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:243(BfruntimeReadWriteRpcException.__init__)
> 1 0.000 0.000 0.000 0.000
> /home/mc36//BF/bf-sde-9.7.0//install//lib/python3.9/site-packages/tofino/bfrt_grpc/client.py:305(_BfruntimeErrorIterator.__iter__)
> 0/2 0.000 0.000 0.000
> /home/mc36/rare/bfrt_python/rare/api/profiler.py:3(BfForwarder.writeProfilerRules)
> [DELETED ATTACHMENT profiler.callgrind, plain text]
> [DELETED ATTACHMENT profiler.pstat, Untyped binary data]
> [DELETED ATTACHMENT profiler.ystat, Untyped binary data]
- [rare-dev] bf_fwd issues, mc36, 05/05/2022
- Re: [rare-dev] bf_fwd issues, mc36, 05/06/2022
- Re: [rare-dev] bf_fwd issues, mc36, 05/06/2022
- Re: [rare-dev] bf_fwd issues, Alexander Gall, 05/06/2022
- Re: [rare-dev] bf_fwd issues, mc36, 05/06/2022
- Re: [rare-dev] bf_fwd issues, Alexander Gall, 05/06/2022
- Re: [rare-dev] bf_fwd issues, mc36, 05/06/2022
- Re: [rare-dev] bf_fwd issues, mc36, 05/06/2022
- Re: [rare-dev] bf_fwd issues, Alexander Gall, 05/11/2022
- Re: [rare-dev] bf_fwd issues, mc36, 05/06/2022
- Re: [rare-dev] bf_fwd issues, Frédéric LOUI, 05/06/2022
- Re: [rare-dev] bf_fwd issues, mc36, 05/06/2022
- Re: [rare-dev] bf_fwd issues, mc36, 05/06/2022
- Re: [rare-dev] bf_fwd issues, mc36, 05/06/2022
- Re: [rare-dev] bf_fwd issues, mc36, 05/06/2022
- Re: [rare-dev] bf_fwd issues, Alexander Gall, 05/06/2022
- Re: [rare-dev] bf_fwd issues, mc36, 05/06/2022
- Re: [rare-dev] bf_fwd issues, mc36, 05/07/2022
- Re: [rare-dev] bf_fwd issues, Alexander Gall, 05/06/2022
- Re: [rare-dev] bf_fwd issues, mc36, 05/06/2022
- Re: [rare-dev] bf_fwd issues, mc36, 05/06/2022
Archive powered by MHonArc 2.6.19.