Json

A hyper-fast and safe Python module to read and write JSON data

hyperjson A hyper-fast, safe Python module to read and write JSON data. Works as a drop-in replacement for Python’s built-in json module. This is alpha software and there will be bugs, so maybe don’t deploy to production just yet. Installation pip install hyperjson Usage hyperjson is meant as a drop-in replacement for Python’s jsonmodule: >>> import hyperjson >>> hyperjson.dumps([{“key”: “value”}, 81, True]) ‘[{“key”:”value”},81,true]’ >>> hyperjson.loads(“””[{“key”: “value”}, 81, true]”””) [{u’key’: u’value’}, 81, True] Motivation Parsing JSON is a solved problem; so, […]

Read more
Tool

FUSE filesystem Python scripts for Nintendo console files

ninfs ninfs (formerly fuse-3ds) is a FUSE program to extract data from Nintendo game consoles. It works by presenting a virtual filesystem with the contents of your games, NAND, or SD card contents, and you can browse and copy out just the files that you need. Windows, macOS, and Linux are supported. Supported types Nintendo 3DS CTR Cart Image (“.3ds”, “.cci”) CDN contents (“cetk”, “tmd”, and contents) CTR Importable Archive (“.cia”) Executable Filesystem (“.exefs”, “exefs.bin”) Nintendo 3DS NAND backup (“nand.bin”) […]

Read more
Tool

A tool gathering email accounts informations from different public source

Infoga – Email OSINT Infoga is a tool gathering email accounts informations (ip,hostname,country,…) from different public source (search engines, pgp key servers and shodan) and check if emails was leaked using haveibeenpwned.com API. Is a really simple tool, but very effective for the early stages of a penetration test or just to know the visibility of your company in the Internet. Installation $ git clone https://github.com/m4ll0k/Infoga.git $ cd Infoga $ python setup.py install $ python infoga.py This script is Tested […]

Read more
Tool

A low-overhead logging/debugging/profiling tool that can trace and visualize

VizTracer VizTracer is a low-overhead logging/debugging/profiling tool that can trace and visualize your python code execution. You can take a look at the demo result of multiple example programs. The UI is powered by Chrome Trace Viewer. Use “AWSD” to zoom/navigate. More help can be found by clicking “?” on the top right corner. Highlights Detailed function entry/exit information on timeline with source code Super easy to use, no source code change for most features, no package dependency Optional function […]

Read more
Data Analysis

Synchrosqueezing, wavelet transforms, and time-frequency analysis in Python

Synchrosqueezing in Python Synchrosqueezing is a powerful reassignment method that focuses time-frequency representations, and allows extraction of instantaneous amplitudes and frequencies. Features Continuous Wavelet Transform (CWT), forward & inverse, and its Synchrosqueezing Short-Time Fourier Transform (STFT), forward & inverse, and its Synchrosqueezing Wavelet visualizations and testing suite Generalized Morse Wavelets Ridge extraction Fastest wavelet transforms in Python1, beating MATLAB 1: feel free to open Issue showing otherwise Installation pip install ssqueezepy. Or, for latest version (most likely stable): pip install […]

Read more
Robot

An easy-to-use Discord bot written in Python

AniSearch AniSearch is an easy-to-use Discord bot written in Python that allows you to search for anime, manga, characters, staff, studios and much more directly in Discord and displays the results as paginated embeds! You can also: Search for a random anime or manga of a specific genre. View the opening and ending themes of an anime. View another user’s profile with anime and manga stats from AniList, MyAnimeList or Kitsu. Search for the anime or the source of an […]

Read more
Machine Learning

A repository of PyBullet utility functions for robotic motion planning

pybullet-planning (ss-pybullet) A repository of PyBullet utility functions for robotic motion planning, manipulation planning, and task and motion planning (TAMP). This repository was originally developed for the PDDLStream (previously named STRIPStream) approach to TAMP. With the help of Yijiang Huang, a stable and documented fork of ss-pybullet named pybullet_planning is available through PyPI. However, new features will continue to be introduced first through ss-pybullet. Installation Install PyBullet on OS X or Linux using: $ pip install numpy pybullet $ git […]

Read more
Advanced, NLP, Project, Python, Structured Data, Supervised, Technique, Text

A Guide to Feature Engineering in NLP

Overview Feature engineering in NLP is understanding the context of the text. In this blog, we will look at some of the common feature engineering in NLP. We will compare the results of a classification task with and without doing feature engineering   Table of Content Introduction NLP task overview List of features with code Implementation Results comparison with and without doing feature engineering Conclusion Introduction   “If 80 percent of our work is data preparation, then ensuring data quality […]

Read more
denoising parallel corpora, NLP

Issue #126 – Learning Feature Weights for Denoising Parallel Corpora

15 Apr21 Issue #126 – Learning Feature Weights for Denoising Parallel Corpora Author: Dr. Patrik Lambert, Senior Machine Translation Scientist @ Iconic Introduction Large web-crawled parallel corpora constitute a very useful source of data to improve neural machine translation (NMT) engines. However, their effectiveness is reduced by the large amount of noise they usually contain. As early as in issue #2 of this series, we pointed out that NMT is particularly sensitive to noise in the training data. In issue […]

Read more
1 … 688 689 690 691 692 … 947