sglang_v0.5.2

History

hailin c8e8c1e9ff .		2025-09-20 16:09:34 +08:00
..
go	.	2025-09-20 16:09:34 +08:00
python/greeter	.	2025-09-20 16:09:34 +08:00
swift/Greeter	.	2025-09-20 16:09:34 +08:00
ts/greeter	.	2025-09-20 16:09:34 +08:00
README.md	.	2025-09-20 16:09:34 +08:00
greeter.fbs	.	2025-09-20 16:09:34 +08:00

README.md

Languages known issues

Python

Assert the type required in your server/client since python is able to receive Bytes array or utf8 strings.

def SayHello(self, request, context):
    # request might be a byte array or a utf8 string

    r = HelloRequest.HelloRequest().GetRootAs(request, 0)
    reply = "Unknown"
    if r.Name():
        reply = r.Name()
    # Issues might happen if type checking isnt present.
    # thus encoding it as a `reply.decode('UTF-8')`
    return build_reply("welcome " + reply.decode('UTF-8'))

This can be prevented by making sure all the requests coming to/from python are Bytes array

def say_hello(stub, builder):
    hello_request = bytes(builder.Output())
    reply = stub.SayHello(hello_request)
    r = HelloReply.HelloReply.GetRootAs(reply)
    print(r.Message())

Go

Always requires the content-type of the payload to be set to application/grpc+flatbuffers

example: .SayHello(ctx, b, grpc.CallContentSubtype("flatbuffers"))