Any OSI or FSF approved open source license does not allow to put restrictions on who can use the software and for what purpose.
The FSF calls these the essential freedoms 0 and 1:
- The freedom to run the program as you wish, for any purpose (freedom
0).
- The freedom to study how the program works, and change it so it
does your computing as you wish (freedom 1).
The OSI definition of open source forbids discrimination against groups and field of endeavor. This is incompatible with any restrictions on how the code may be changed:
- No Discrimination Against Persons or Groups
The license must not discriminate against any person or group of
persons.
- No Discrimination Against Fields of Endeavor
The license must not restrict anyone from making use of the program in
a specific field of endeavor. For example, it may not restrict the
program from being used in a business, or from being used for genetic
research.
As long as all downstream users comply with your license terms, there is nothing you can do... as long as you still want to call your project rightfully open source.
You can of course release it under a license which is identical to a common copyleft license but includes additional clauses which restrict what people can do with it, but then you can no longer call it open source or free software.