The tool to check the availability or syntax of domain, IP or URL.
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
Hello, World!
I hope that everything is going right for you and your loved one. This release just provides an improvement of the way we open and close a connection to a MySQL/MariaDB database.
Let me know what you think or how you use PyFunceble with #PyFunceble or @PyFunceble on Twitter :smile:!
I wish you all the best. Stay safe and healthy!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
Hello, World!
I hope that everything is going right for you and your loved one. This release just provides some improvements and a few new features.
There are a few important changes to notice. The first one is the switch from raw SQL to SQLAlchemy. The reason behind the switch is a change in the development process. I cannot endorse nor want to maintain raw SQL anymore. To understand the matter, before the switch to SQLAlchemy I had code blocks that handled MySQL connections and statements and another one to handle MariaDB connections and statements. Most of the time it was 1 block for both but in other - not so peaceful - parts there were 2. Meaning that I was handling every use case by myself. With SQLAlchemy, we have 1 line/block for multiple database types. Of course we only support MariaDB and MySQL but it simplifies the integration of other database types in the future. The other reason which convinced me that it's the right way is that it forced me to review and simplify the table structure. Meaning that:
To simplify the switch and keep it as smooth as possible, a migrator is integrated into PyFunceble. That way, you don't have to take any special action, PyFunceble will handle everything.
The second important change is the sorting algorithms that were improved. Meaning that I simplified them to be efficient but before anything correct. This change has been made because the sorting of digits was not human friendly. So I took advantage of the issue to completely improve the sorting algorithms.
The third important change is the introduction of new special rules which I let you discover through the documentation.
The fourth and last important change is the new --store-whois
argument and logic. Before the introduction of this logic, we were storing the whois WHOIS record into the database. From now, it's only if it is needed by you. The idea behind this is to reduce the size of our database. Please note that the database migrator will follow this argument too.
There is a lot more but that's it for the most important changes!
Let me know what you think or how you use PyFunceble with #PyFunceble or @PyFunceble on Twitter :smile:!
I wish you all the best. Stay safe and healthy!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
--multiprocess
argument.db_types
directory as it is now obsolete.--clean
and --clean-all
arguments.*.wix.com
special rule.*.hpg.com.br
special rule.*.000webhostapp.com
special rule.*.angelfire.com
special rule.--store-whois
argument and logic.--domain
and --url
arguments.--all
argument prints everything.PYFUNCEBLE_DEBUG
and PYFUNCEBLE_DEBUG_ONSCREEN
environment variables.Thanks to those awesome people who contributed to this release!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
Hello, World!
I hope that everything is going right for you and your loved one. This release just provides a :fire: issue which was provided by my last release.
Indeed, as I automate everything, I did not notice that the input file was being deleted.
The reason for the 3.2.2
instead of the 3.2.1
is because I did a mistake in the versioning a few days ago which resulted in me being forced to release 3.2.1
to PyPi and all other platforms.
Let me know what you think or how you use PyFunceble with #PyFunceble or @PyFunceble on Twitter :smile:!
I wish you all the best. Stay safe and healthy!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
Thanks to those awesome people who contributed to this release!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
Hello, World!
I hope that everything is going right for you and your loved one. This release just provides some fixes and very few new features.
This release includes one important change. Indeed, in the previous version, I included the notion of "shadow file" and made it default.
I now consider that decision as a bad one because it may have created unexpected behaviors especially while talking about execution time for some huge lists.
Therefore, from now, if you want to use that feature, you should use or append the --shadow
argument or its configuration equivalent to access it.
The other important thing which is not a change is the deployment and provision of docker images and conda packages to the grand-public.
That means that from now, you can install PyFunceble (or its -dev
counterpart) from PyPi, AUR, Docker Hub, and Anaconda Cloud. I spend a huge amount of time to automate the process. So, let me know if something is wrong with the two new repositories.
Let me know what you think or how you use PyFunceble with #PyFunceble or @PyFunceble on Twitter :smile:!
I wish you all the best. Stay safe and healthy!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
output/
directory is missing.NoneNone
.-m
argument.urllib3
.output/
directory. It can be done through the PYFUNCEBLE_OUTPUT_LOCATION
environment variable.--shadow
argument or its configuration counterpart.Thanks to those awesome people who contributed to this release!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
Hello, World!
I hope that everything is going right for you and your loved one. This release took a bit of time because it was hard to find some time to give it some love. Anyway, here we are!
This release includes 2 important changes. The first one, is the fix of the way we connect to your MariaDB or MySQL database. There was a bug because I assumed that PyMySQL will close the connection by itself while using the with-statement. It turns out that it was not the case.
The second one and probably the most important one, is the inclusion of the self-cleaning of the inactive database. After collecting data in your local storage, this feature was highly wanted and here it is. Indeed, before today, the system was collecting and saving information into the inactive database but it never cleaned the unneeded one. From now, and after 28 days sitting in there, a subject will be automatically removed.
I spend most of my time restructuring the documentation so that we could export it into PDF without having to lose the structure. I was a bit shocked by the generated PDF, that I restructured the whole documentation for it to be rendered correctly. As you know, using PyFunceble requires an internet connection so PDF won't be a big deal. But on my side, I would like to be able (and to start) to download the PDF, print it, and correct what I wrote. That's how I will try to work in the coming month in order to complete the documentation.
By the way, I would like to thank all of those who contributed to the documentation! A lot of work is still waiting but we will come that far one day.
Let me know what you think or how you use PyFunceble with #PyFunceble on Twitter :smile:!
I wish you all the best. Stay safe and healthy!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
.pyfunceble-env
file for those who use the MySQL or MariaDB database.--dots
argument and logic.Thanks to those awesome people who contributed to this release!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
Hello, World!
I'm glad to announce this new major version of PyFunceble!
It took me some time, but it's time to release this new version. This version provides a complete different tool. Indeed, the structure and the components of the project are totally different. The idea of this major version was mainly to review the structure, but it went beyond my expectation thanks to the awesome users and contributors who gave some amazing feedback about PyFunceble(-dev).
One of the most fun I had, among the fix and development of new features, is the implementation of a total automation behind the generation and distribution of the IANA and Public Suffix databases file and the User-Agents. Indeed, before this version, I had to generate them and your own instance of PyFunceble had to fetch it after each release. From now, they are totally automated, and your own instance of PyFunceble will fetch and get the latest one when it judge that it's necessary to update your local version (generally after 24 hours).
This version is also the beginning of a new adventure, some new features and ideas.
Between what you may discover by yourself in this version, there is the support of GitLab CI/CD, IPv6 and even DNS over TCP to just name them. As a list maintainer, this version provides you a switch which will checks the reputation of the subjects in your list with the help of the AlienVault's public reputation data. I highly invite you to check that as I'm thinking about the inclusion or improvement of reputation data in the future.
As a lot has been fixed, therefore, I'm not going to list them here, but if there are questions about the changes in details or a behavior which changed, please let me know on Keybase!
Let me know what you think or how you use PyFunceble with #PyFunceble on Twitter :smile:!
I wish you all the best!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
.onion
TDL is not INVALID
anymore.*.github.io
which return 404
are returned as INACTIVE
.The migration to 3.x is normally done automatically through the configuration checker.
In some rare case (and before submitting a new issue), you may delete your configuration files (.PyFunceble_production.yaml
and .PyFunceble.yaml
) first.
Thanks to those awesome people who contributed to this release!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
Hello, World!
Here is a quick fix of the --clean-all
argument.
Indeed before this release when --clean-all
was used along with the MySQL, SQLite or MariaDB database type, everything was literally cleaned.
From now, everything except the WHOIS database table is deleted. Why not the WHOIS database? It simple, it's actually a static file which saves information about domains and is used every time you retest something with PyFunceble to reduce test time.
Let me know what you think or how you use PyFunceble with #PyFunceble on Twitter :smile:!
I wish you all the best!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
--clean-all
logic while using a database type different from JSON.Thanks to those awesome people who contributed to this release!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
Hello, World!
Here is a quick fix of the --local
argument (and its configurable equivalent).
Indeed before this release in some rare cases, it is possible that an AttributeError
might be raised.
For more accuracy, I renamed the source IANA
to Syntax
. That's it for this new release!
Let me know what you think or how you use PyFunceble with #PyFunceble on Twitter :smile:!
I wish you all the best!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
AttributeError
which appear in some rare cases while using the --local
argument.INVALID
output. It is not IANA
but SYNTAX
.:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
Hello, World!
I'm glad to announce this new major version of PyFunceble!
Many of you (if not everybody) wrote, talked and/or mentioned that PyFunceble is a great idea but it takes some times if not days to test lists. Let me invite you to review your input with this new version which offers the usage of multiprocessing (as an option) while testing for files.
This new version includes many improvements, review and sometimes complete rewrite of most (if not all) subsystems. As we are all human, I strongly invite you to report any issue which you might meet or get with this new version. A lot of things have been taken into consideration to minimize issue but I'm and you should still stay aware that even if we are stable enough, bugs can emerge from nowhere.
Let me know what you think or how you use PyFunceble with #PyFunceble on Twitter :smile:!
I wish you all the best!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
percentage.txt
file which did not work when the quiet/silent mode was in use.iana-domains-db.json
iana-domains-db.json
.public-suffix.json
.PYFUNCEBLE_CONFIG_DIR
which will replace PYFUNCEBLE_OUTPUT_DIR
in the future.output/
directory structure from the API.www.example.org
if example.org
is given and vice-versa.--local
argument from the CLI or its configuration equivalent.INVALID
.
percentage.txt
.Thanks to those awesome people who contributed to this release!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2: Hello, World!
This release provides a minor but still important fix of the auto continue subsystem. Indeed, thanks to @dnmTX, I was able to find out that the auto continue subsystem was working wrongly. In fact, I was first filtering the whole list before trying to get the part we are going to test. Now I get the part we are going to test then process the filtering of all elements which are into the different databases.
Otherwise, because it was asked to me privately, we now write stdout with the output of the git push
command when under Travis CI.
Finally, dear Arch Linux (and derivated) users, please note that from now, the package name changed. Indeed, it is now pyfunceble
for the stable version and pyfunceble-dev
for the development version.
I wish you all the best!
:tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2::tada: :star2:
Thanks to those awesome people who contributed to this release!