Transformer

LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence

LayerNorm(SmallInit(Embedding)) in a Transformer I find that when training a transformer, the embedding matrix moves slowly, hence it’s difficult for the model to jump out of the initial noisy embedding. (initial embedding) [[-0.0073 0.0062 -0.0261 … 0.0086 0.0107 -0.008 ] … ] (after 1 step, the directions of the embedding vectors are not moved much because the numbers change by ~LR = ~4e-4) [[-0.0069 0.0066 -0.0265 … 0.009 0.0111 -0.0084] … ] So I propose initializing the embedding matrix to […]

Read more
Django

A web app showcasing OAuth2.0 + OpenID Connect using Firebase, Django-Rest-Framework and React

OAuth2.0 What is OAuth? OAuth is an authorization protocol that provides users to grant websites or applications access to their information on other websites Oauth became so popular that people started using OAuth for authentication, which OAuth is not built for. That’s where OpenID connect comes in. OpenID connect is on the top layer of oauth2.0 which provides authentication to users on the server side. This is image was taken from a talk given by Nate Barbettini you can check […]

Read more
Encryption

A streaming wrapper around python tarfile and allow secure handling files and support encryption

Secure Tarfile library It’s a streaming wrapper around python tarfile and allow secure handling files and support encryption. with SecureTarFile(“test.tar”, “w”) as tar_file: atomic_contents_add( tar_file, temp_orig, excludes=[], arcname=”.”, ) with SecureTarFile(“test.tar”, “w”, b”AES128_KEY_SIZE”) as tar_file: atomic_contents_add( tar_file, temp_orig, excludes=[], arcname=”.”, ) GitHub View Github    

Read more
Job Scheduler

Start and stop your NiceHash miners using this script

Use this script to schedule all of your NiceHash Miner(s) to turn on and off at certain times of the day. Electricity costs between 4-9pm are high in my area and I want NiceHash to stop mining during those times. This script should start and stop your rigs on a schedule. Setting up this scheduling process could take up to 1 hour depending on your skill level Installation Acquire the necessary files by downloading the latest release. Save and extract […]

Read more
Logging

A Python package which supports global logfmt formatted logging

A Python package which supports global logfmt formatted logging. Install $ pip install logfmter Usage Before integrating this library, you should be familiar with Python’s loggingfunctionality. I recommend reading the Basic LoggingTutorial. This package exposes a single Logfmter class that can be integrated intothe standard library logging system similar to any logging.Formatter. The provided formatter will logfmt encode all logs. Key value pairs are providedvia the extra keyword argument or by passing a dictionary as the log message. Basic import […]

Read more
Wordle

API that provides Wordle (ES) solutions in JSON format

API that provides Wordle (ES) solutions in JSON format. From 2022-01-07 to 2023-09-15. Game URL: https://wordle.danielfrg.com/ Usage curl https://wordle-solutions.herokuapp.com/ Examples: curl https://wordle-solutions.herokuapp.com/ # Returns all solutions curl https://wordle-solutions.herokuapp.com/2022-02-06 # Returns solution of the day Recommendation: use jq to parse. Why? Weekend project. Unlike original Wordle version, solutions are (client-side) encrypted. Seemed funny to script. Future work (not me) Maybe a front-end? Disclaimer Crappy code. GitHub – alvarontwrk/wordle-solutions at pythonawesome.com API that provides Wordle (ES) solutions in JSON format. – GitHub […]

Read more
Discord

Start and manage your Minecraft server from a Discord bot

Do you want a Discord Bot to start your Minecraft server? This program will help you do just that! Features This script starts your Minecraft server and shuts it down too! It also shuts down the server when it’s inactive. Commands There are 6 commands that can be used by anyone: /start will start the Minecraft server if it’s not already running. /stop will shut down the Minecraft server if no players are online. /info will give you the server […]

Read more
Generator

A simple account generator not using paid solving services

Star this if it helped to spread awareness! No 2captcha, or any solving services, 100% free This is a fork/mix of dhirk07’s 5 letter sniper, and roblox-thot‘s captchaCodeMakerv2You solve the captcha, then get the code from this site by roblox-thot, afterwards it outputs the generated accounts to a file with the name of “out.txt” in user:pass:cookie format. Python3 with pip installed. That’s all. pip install -r requirements.txt python3 gen.py DO NOT BE IDIOTIC AND RE-SELL THIS CODE. GNU General Public […]

Read more
Challenge

Writeup for the Nightmare CTF Challenge from 2022 DiceCTF

TLDR: One byte write, no leak. Infinite loop through overwrite of binaries link map Determination of useful rop gadget, has to fit several extensive criteria Partial overwrite of DT_JMPREL table pointer Partial overwrite of DT_STRTAB pointer Overwrite of LIBC link map Loop 2-5 until rop chain has been created Partial overwrite of DT_FINI_ARRAYSZ pointer Use 3 & 4 to call exit, to call rop chain Prologue This challenge was extremely difficult and I recommend reading the original author’s writeup to […]

Read more
1 … 206 207 208 209 210 … 915