Conversion between C structs (C++ POD) and google protobufs?

Question

I have code that currently passes around a lot of (sometimes nested) C (or C++ Plain Old Data) structs and arrays.

I would like to convert these to/from google protobufs. I could manually write code that converts between these two formats, but it would be less error prone to auto-generate such code. What is the best way to do this? (This would be easy in a language with enough introspection to iterate over the names of member variables, but this is C++ code we're talking about)

One thing I'm considering is writing python code that parses the C structs and then spits out a .proto file, along with C code that copies from member to member (in either direction) for all of the types, but maybe there is a better way... or maybe there is another IDL that already can generate:

1. .h file containing all of nested types
2. .proto file containing equivalents
3. .c file with functions that copy either direction between the C++ structs that the .proto file generates and the structs defined in the .h file

Answer 1

I could not find a ready solution for this problem, if there is one, please let me know!

If you decide to roll your own in python, the python bindings for gdb might be useful. You could then read the symbol table, find all structs defined in specified file, and iterate all struct members. Then use <gdbtype>.strip_typedefs() to get the primitive type of each member and translate it to appropriate protobuf type.

This is probably safer then a text parsers as it will handle types that depends on architecture, compiler flags, preprocessor macros, etc.

I guess the code to convert to and from protobuf also could be generated from the struct member to message field relation, but does not sound easy.

Answer 2

Protocol buffers can be built by parsing an ASCII representation using TextFormat. So one option would be to add a method dumpAsciiProtoBuf to each of your structs. The method would dump any simple fields (like strings, bools, etc) and call dumpAsciiProtoBuf recursively on nested structs fields. You would then have to make sure that the concatenated result is a valid ASCII protocol buffer which can be parsed using TextFormat.

Note though that this might have some performance implications (since parsing the ASCII representation could be expensive). However, this would save you the trouble of writing a converter in a different language, so it seems to be a convenient solution.

Answer 3

I would not parse the C source code myself, instead I would use the LibClang to parse C files into an AST and my own AST walker to generate the Protobuf and the transcoders as necessary. Googling for "libclang walk AST" should give something to start with, like ast-walker.cc and ast-dumper.cc from this github repository, for example.