3483 Commits

Author SHA1 Message Date
Kawe Mazidjatari
c4691448c1 RTech: initial custom pak compression implementation
Allows paks compressed with ZSTD, to be stream decoded at run time. Currently seems to work pretty good, but needs to be further battle tested + cleaned up still.
2024-04-05 17:54:05 +02:00
Kawe Mazidjatari
2b06bc8abb Add ZSTD to SDK 2024-04-05 17:53:22 +02:00
Kawe Mazidjatari
dbec4be848 NetworkSystem: rename NetGameServer_t member vars 2024-04-05 17:52:58 +02:00
Kawe Mazidjatari
746cf16f2b MaterialSystem: rename CMaterialGlue member vars 2024-04-05 17:52:57 +02:00
Kawe Mazidjatari
e8be704276 GameUI: cleanup and fix race condition
* Use CThreadFastMutex instead
* Rename ISurface to IDebugSurface to prevent a potential name collision with VGUI's ISurface iface if we ever add it
* Fix race condition when setting CPylon::m_HostIP from materialsystem thread, this has been dispatched to the main thread
* Marked 'pylon_matchmaking_hostname' FCVAR_MATERIAL_SYSTEM_THREAD as we use it in the server browser panel.
2024-04-05 17:52:57 +02:00
Kawe Mazidjatari
4042cb7915 Engine: fix out of bound access
Even though this is handles by the class, it really shouldn't happen.
2024-04-05 17:52:57 +02:00
Kawe Mazidjatari
fcf3a09418 Make singletons use static memory
Avoid heap memory allocation and a level of indirection. This allows the compiler to optimize the program even more. No logic has been changed in this patch.
2024-04-05 17:52:57 +02:00
Kawe Mazidjatari
4662995f2e Playlists: fix resource/memory leak
Remove workaround that was implemented to counter a crash during the beginning of this project, this issue was long solved but the workaround was never removed. Clearing the last precached VPK name prevents the engine from helping other threads to properly unload existing handles, if at all.
2024-04-05 17:52:57 +02:00
Kawe Mazidjatari
fe2a95e4ec RTech: major pak system overhaul and rebuild
* split rtech_game and rtech_utils cpp files into multiple files
* rebuilt several large pak load routines for debugging and custom implementations
* moved rson code to rtech_game
* reworked and improved engine and sdk pak precache system
* reversed more of the jobthreads system
2024-04-05 17:51:19 +02:00
Kawe Mazidjatari
1783db92b5 CMake: improve linker performance
Improve linker performance by either enabling GL and LTGC on certain projects at the same time, enabling it for all projects, or disabling it all together
2024-04-05 17:46:57 +02:00
Kawe Mazidjatari
6766f5be62 Tier1: map out CCvar completely and get the ptr to the actual class instance
Previously we had a ptr to just its vtable; get the ptr to the actual class instance.
2024-04-05 17:46:56 +02:00
Kawe Mazidjatari
3c74070285 Tier0: initialize CThreadFastMutex member vars
Must be null
2024-04-05 17:46:56 +02:00
Kawe Mazidjatari
50761d24a8 Tier0: cleanup CThreadFastMutex 2024-04-05 17:46:56 +02:00
Kawe Mazidjatari
177078813b Tier0: fix CThreadFastMutex bug
Must break if ThreadInterlockedCompareExchange returns null.
2024-04-05 17:46:56 +02:00
Kawe Mazidjatari
8d7ebeea26 MaterialSystem: fix stream debug formatting bug
Promote to actual 64bit signed size types.
2024-04-05 17:46:56 +02:00
Kawe Mazidjatari
8e0e42cdab Tier1: add assert in CCommand::Arg()
This code path shouldn't be hit.
2024-04-05 17:46:56 +02:00
Kawe Mazidjatari
d7e1b88569 ReVPK: improve logger name formatting 2024-04-05 17:46:56 +02:00
Kawe Mazidjatari
a1ba022fef VpkLib: fix bug when parsing directory tree base name
After the regex update in commit 5266a2e9, this function had to be updated as well since the underscore is no longer returned.
2024-04-05 17:46:56 +02:00
Kawe Mazidjatari
5f09f1434c VpkLib: simplify tree header writer
Make sure the VPK header is always initialized to 0 instead of actual values, as otherwise it would cause the reader to succeed on truncated files if at least the first byte matches that of the VPK magic. This also lead to the simplification of the tree header writer; instead of writing the tree size apart from the header, write the whole thing at once.
2024-04-05 17:46:55 +02:00
Kawe Mazidjatari
cb8f0902a4 Netconsole: don't process empty input strings
Caught by assert in CUtlBuffer ctor when tokenizing the input.
2024-04-05 17:46:55 +02:00
Kawe Mazidjatari
3c10bf0e8d Netconsole: refactor & improvements
* Fix multiple issues related to threading, such as not locking the mutex when using thread-unsafe members or methods.
* Netconsole now logs its output to a file on the disk.
* Properly handle close events, to allow netconsole to shutdown properly, so stuff like log buffers could flush properly. Input is now ran in a separate thread so main thread could check if we need to shutdown, and do so if needed. This was needed as previously input was ran in the main thread and the issue is that its blocking until an input is given.
2024-04-05 17:46:55 +02:00
Kawe Mazidjatari
43d771e3cd System: handle other close events as well
Give the engine and SDK time to shutdown properly.
2024-04-05 17:46:55 +02:00
Kawe Mazidjatari
974a5b2c24 SpdLog: flush the tools logger
Must manually kill the pointer on shutdown to flush it since this one is allocated by us and thus not managed by SpdLog.
2024-04-05 17:46:55 +02:00
Kawe Mazidjatari
cdcd7b8272 SpdLog: add truncate option for tools file logger, and default it on
By default spdlog will append on top of existing logs, but for ReVPK we want to truncate the old ones and start over again.
2024-04-05 17:46:55 +02:00
Kawe Mazidjatari
19e67499e6 SpdLog: fix warning for tools code
Static linkage and not used for tools; idfed'd out.
2024-04-05 17:46:55 +02:00
Kawe Mazidjatari
22bb9eef4f Engine: fix compiler warning caused by empty control statement
Remove trailing ';', else this branch wouldn't even be compiled in.
2024-04-05 17:46:55 +02:00
Kawe Mazidjatari
92323b7ba7 SpdLog: fix compile error caused by undeclared function
SpdLog_Create() is no longer externed through its header as its a static internal function. Moved SpdLog_Create() above SpdLog_Init() to fix the compile error and rename it to SpdLog_CreateRotatingLoggers(), which is a more suitable name.
2024-04-05 17:46:54 +02:00
Kawe Mazidjatari
21758f5c9c Sync ReVPK fixes to packedstore concommand
* Check if workspace directory exists.
* Check if VPK directory tree file was successfully parsed.
2024-04-05 17:46:54 +02:00
Kawe Mazidjatari
bf59f6c2c5 ReVPK: bug fixes & improvements
* Make sure the workspace path actually exists before attempting to pack it.
* Make sure the VPK directory tree file was parsed correctly before unpacking store.
* Log debug output for each pack operation to a file.
* Fix bug in s_DirFileRegex regex pattern, which would include a trailing '_' in the context part of the directory tree file name.
* Fix bug in 'GetLevelName()' and 'GetDirNameParts()' causing it to parse the path as well, prune the path before running the regex.
* Renamed 'GetLevelName()' to 'PackedStore_GetDirLevelName()'.
* Renamed 'GetDirNameParts()' to 'PackedStore_GetDirNameParts()'.
* Write a front-end enable file when building client VPK's.
2024-04-05 17:46:54 +02:00
Kawe Mazidjatari
8ff1404c4d VpkLib: move header check to dir construction and flag error on failure
Moved the construction as otherwise we would iterate over potentially bad or incompatible data.
2024-04-05 17:46:54 +02:00
Kawe Mazidjatari
6f0fdd56ce VpkLib: add comments to name sanitizer
Make it clear what it does.
2024-04-05 17:46:54 +02:00
Kawe Mazidjatari
7304c3782d VpkLib: fix bug in dir tree file name sanitizer
The sanitizer never worked as we never replaced the corresponding string.
2024-04-05 17:46:54 +02:00
Kawe Mazidjatari
465d905056 VpkLib: fix bug in GetManifest()
Check if the parsing was actually successful, else free and return nullptr. The null check at call site never worked since we never return null on failure.
2024-04-05 17:46:53 +02:00
Kawe Mazidjatari
5f554867a1 VpkLib: check for manifest file first before opening the pack file
We do this as if we happen to not have any manifest whatsoever, but already opened the block file, and the block file already existed and was still valid, it would be emptied out. Only open it if we are actually going to write into it!
2024-04-05 17:46:53 +02:00
Kawe Mazidjatari
be9d5c6e24 FileSystem: implement IsDirectory in STD implementation 2024-04-05 17:46:53 +02:00
Kawe Mazidjatari
e6ba904f96 VokLib: rename pack/unpack methods
More correct names.
2024-04-05 17:46:53 +02:00
Kawe Mazidjatari
28cc532e9c ReVPK: add option for num helper threads and compress levels
Allow the user to set the # amount of helper threads and the compress level of the VPK's.
2024-04-05 17:46:53 +02:00
Kawe Mazidjatari
c8fff61696 ReVPK: add documentation and options for custom paths 2024-04-05 17:46:53 +02:00
Kawe Mazidjatari
2b0837fa93 VpkLib: allow directory recursion
This is offline tools code, no security risks here.
2024-04-05 17:46:53 +02:00
Kawe Mazidjatari
ff7c3b1435 Tier1: feature proper size types for CFmtStrN
Promote to 64bit for target platform.
2024-04-05 17:46:53 +02:00
Kawe Mazidjatari
abbed191c2 Tools: check CPU for SSE2
SSE and SSE2 instructions are being used, check for them instead of crashing somewhere in the program.
2024-04-05 17:46:52 +02:00
Kawe Mazidjatari
9b9aad8bee RTech: fix bug in pakfile decompress callback
* Fix decompress size check.
* Fix incorrect decompress buffer allocation size.
2024-04-05 17:46:52 +02:00
Kawe Mazidjatari
9b3dd97792 VpkLib: rename CPackedStore to CPackedStoreBuilder
Avoid confusion with the game's CPackedStore class.
2024-04-05 17:46:52 +02:00
Kawe Mazidjatari
6841f5bb19 VpkLib: cleanup packed store class
Make the utility methods statics within the implementation so it could be used by other structs/classes of the VPK builder as well, these utility functions weren't useful outside the class. This also allowed for the removal of the singleton which had no purpose whatsoever.
2024-04-05 17:46:52 +02:00
Kawe Mazidjatari
195df6d0e8 FileSystem: fix bug in tools implementation
Should read element count of bytes instead of element count of file size, else this always returns 1 instead of the actual number of bytes read/written.
2024-04-05 17:46:52 +02:00
Kawe Mazidjatari
7cbb8a994d KeyValues: fix bug when loading from file
Read file as binary, and check if the file we're opening has a size.
2024-04-05 17:46:52 +02:00
Kawe Mazidjatari
6f11fffe63 Tier0: fix netconsole and revpk compile error in debug
CCommandLine isn't implemented in tools, thus unresolved external symbol errors will be thrown. HushAsserts() was unused and therefore removed which fixes these errors.
2024-04-05 17:46:52 +02:00
Kawe Mazidjatari
89bb7f35c8 KeyValues: fix singleton accessor compile errors
Make each instance implement the accessor instead of the KeyValues system itself.
2024-04-05 17:46:51 +02:00
Kawe Mazidjatari
ab58decd9b CMake: add ReVPK project, standalone VPK tool
Standalone VPK tool that does everything the VPK tool implemented in the dedicated server does (pack, unpack), but independent from the game's runtime.
2024-04-05 17:44:07 +02:00
Kawe Mazidjatari
5eb784a882 FileSystem: add standalone implementation
Standalone FileSystem implementation, allowing SDK code to be used in tools without adjusting them as the vtables remain identical. NOTE that this reimplementation is partial and only contains the reading and writing of files to/from buffers or disk as that's what we are mainly interested at. We can always implement the other methods when needed.

NOTE: the filesystem singleton accessor (CFileSystem_Stdio* FileSystem()) has been moved to an implementation file instead of being inline as this would allow existing code to link to the tools implementation instead.
2024-04-05 17:42:55 +02:00