This project has been deleted.

ConnectorLib

ConnectorLib

26 devlogs
74h 30m
Created by Ethan

This is an ecosystem of components designed to interact with each other in order to collect analytics from a Minecraft client. It consists of a minecraft mod that runs on the client (server side coming soon) and a server that the client connects to and sends data such as player positions and server uptime.

Timeline

Ship 3

1 payout of shell 185.0 shells

Ethan

about 1 year ago

Ethan • Covers 9 devlogs and 23h 18m
Earned sticker

Finished on adding integration with mcsr for some player statistics if they have used speedrun mods

Update attachment
Earned sticker

worked on adding integration with the MCSR api for tracking player stats if using the speedrunning mods (data is published publicly by default)

Update attachment

we now use the api to fetch the server list instead of hardcoding it into a config file
+ quite a few bug fixes & reducing the number of api calls

Update attachment

added first graph and fixed up the player scroller

Update attachment

finished writing the api endpoint for server grabbing
started work on the analytics page for each server
page currently has icon, sanitized motd, player list
sidebar now has indicator of if a server is online and if the server has the mod installed

Update attachment

started work on the UI, added per-server map and got the rest of the UI (current pages) to a satisfactory point. map now scales with nearest-neighbor past the resolution provided by the map server (so you can zoom past level 3, currently max set to 6)

Update attachment

Moved a bunch of very generic stuff over to a library mod which will make it much easier to use in other mods. Also it adds this small frog to the main menu.

This devlog includes time spent creating the croaklib mod that stores common code between my different mods such as update checkers and certain cosmetic things.

Update attachment
Ethan Ethan over 1 year ago
time tracking broken, devlog doesn’t include the time working on the library mod https://i.imgur.com/QZtauCa.png says 12h but doesn’t log it oh well

add the rust server to the docker compose with a custom Dockerfile

Update attachment

moved the config for the encryption key into a .env for the server and the config file for the client

Update attachment

Ship 2

1 payout of shell 167.0 shells

Ethan

over 1 year ago

Ethan • Covers 8 devlogs and 24h 13m

FINALLY FINISHED MOVING OVER TO RUST

The server is now fully reimplemented in rust up to the point it was at in python (plus quite a lot of reorganising and cutting down on unnecessary data and messages)

The server also uses mojangs official api to authenticate the users, which means that the server never knows any login info but can still fully authenticate the clients

Check out https://github.com/meeplabsdev/connectorlib-server/commit/288dafadc9c7502bbec78f10d0c5c5b6c47df1c0 if you're interested in seeing all of the changes made but the summary is that rust server now logs:

attributes

health
hunger
breath/air underwater
saturation
exhaustion
experience points
protection level from armor
gamemode
fps
ping
current status effects

messages

message content
message type
from player
to player

chunks

dimension
biome
location
heightmap pointmap

inventory

selected slot
item names
item counts
item slots
item data/nbt/components (durability, enchants, etc)

position

location
velocity
dimension
sneaking
sprinting
swimming
crawling
grounded
fallfyling
nearby players and their locations

player

joining a server/world
leaving a server/world
death locations and timings

Update attachment

when doing the position data logging for the player we now also log positions of all other players within a 1024 block cube centered on the player

Update attachment

added ClientPosition to log player positions
renamed ChatData to ClientChat
changed the floats in postgres to be half-precesion (float4)

Update attachment

added the ChatData message to log chat messages

Update attachment

begin work on visualizer webpage - move over to nextui + vite + vite_actix + actix (rust backend) and implement POC map using leaflet (OSM world map) + set website theme

Update attachment

updated mod to work with rust backend and added support for a couple more messages, massive code changes to support msgpack instead of raw json, encrypted messages, new inbound/outbound method of encoding classes, removed auto-reconnect for now (will reimplement), authenticate on EVERY websocket join not just some of them since tokens are not carried across sessions now (per-session auth)

Update attachment

added to the client so that it can now decode the msgpack messages back into classes and refactored some code so that inbound and outbound messages are clearly seperated on the client side

Update attachment

began to get the mod working with the new rust backend, got msgpack serializing working but not deserialization yet

also implemented the mojang server join flow so that it can authenticate that the client is sending data from a real account, which prevents modified clients from sending bogus data

Update attachment

Ship 1

1 payout of shell 123.0 shells

Ethan

over 1 year ago

Ethan • Covers 9 devlogs and 26h 58m

add sql template for database

Update attachment

added rust connection to postgres database

Update attachment

add coloured logging and identity authentication with the host-controlled np-p private key and aes-cbc with uuid and username checksum

Update attachment

the expected value (given a nonce and an iv) is now calculated for the IdentityRequest, used to help verify the authenticity of a client

Update attachment

now working on the rust implementation, added the ability for messages to return value back to the client

Update attachment

Started working on the rust port and using messagepack instead of JSON, have the handler selector working for message routing and the messagepack decoder working. Handler selector and messages module are generated at build time.

Update attachment

mainly modifying the chunk messages system, but I will be moving to MessagePack instead of JSON soon

Update attachment

Mod

  • feat: update ChatData to send UUID information along with names
  • feat: update SystemChatData to send UUID information along with names
  • feat: update ChunkData to send translation keys instead of biome names
  • feat: update ConnectorLibMod to abide by the new ChatData and SystemChatData standards
  • feat: update PlayerEffects to send translation keys instead of effect names
  • feat: update velocity and positions to be lists instead of three separate fields
  • feat: update PlayerHotbar to use a HashMap instead of two fields for item names and nbts
  • misc: Clean up code
  • feat: add BulkMessage

Server

  • feat: switch PositionData to use a list[int] for pos instead of three seperate fields
  • feat: add BulkMessage support
Update attachment

Set up project in SoM (work logged on hackatime was adding websocket auto-reconnect to mod and fixing some bugs server/db side)

Update attachment